-- Logs begin at Tue 2022-09-13 19:05:57 UTC, end at Tue 2022-09-13 20:10:01 UTC. -- Sep 13 19:41:23.909152 dv-cinder-828806-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 19:41:23.917798 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 19:41:23.920052 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:41:23 2022] *** Sep 13 19:41:23.920052 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:41:23.920052 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:41:23.920052 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: nodename: dv-cinder-828806-6-iscsi Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: machine: x86_64 Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: clock source: unix Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: pcre jit disabled Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: detected number of CPU cores: 4 Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: current working directory: / Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: your processes number limit is 47680 Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: your memory page size is 4096 bytes Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: detected max file descriptor number: 2048 Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: lock engine: pthread robust mutexes Sep 13 19:41:23.920356 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: thunder lock: enabled Sep 13 19:41:23.921064 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 19:41:23.921064 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:41:23.961749 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: Python main interpreter initialized at 0x5608a06219c0 Sep 13 19:41:23.961749 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: python threads support enabled Sep 13 19:41:23.961749 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: your server socket listen backlog is limited to 100 connections Sep 13 19:41:23.961749 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:41:23.962197 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:41:23.962197 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: *** Operational MODE: preforking *** Sep 13 19:41:23.962526 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:41:23.962526 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: spawned uWSGI master process (pid: 117102) Sep 13 19:41:23.962754 dv-cinder-828806-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 19:41:23.964668 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: spawned uWSGI worker 1 (pid: 117103, cores: 1) Sep 13 19:41:23.964668 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: spawned uWSGI worker 2 (pid: 117104, cores: 1) Sep 13 19:41:23.964668 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:41:24.622193 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:41:24.630477 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:41:25.704449 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:41:25.704449 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: from cryptography.utils import int_from_bytes Sep 13 19:41:25.705207 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:41:25.705207 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: from cryptography.utils import int_from_bytes Sep 13 19:41:25.705577 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:41:25.705577 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: from cryptography.utils import int_from_bytes Sep 13 19:41:25.705688 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:41:25.705688 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: from cryptography.utils import int_from_bytes Sep 13 19:41:28.188016 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:41:28.188629 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:41:28.189006 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:41:28.189089 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:41:28.189174 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:41:28.189244 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:41:28.189309 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:41:28.189385 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:41:28.189452 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:41:28.189610 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:41:28.189767 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.189963 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.190063 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.190312 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.190444 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.190599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.190698 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.190948 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.191092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.191242 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.191331 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.191576 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.191709 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.191864 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.191969 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.192209 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.192353 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.192441 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.192525 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.192758 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.192943 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.193089 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.193185 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-6-iscsi {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.193423 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.193563 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-6-iscsi {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.193735 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.193866 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.194038 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.194177 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.194343 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.194474 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.194643 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.194786 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.194935 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.195034 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.195231 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.195318 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.195543 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.195720 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.196045 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.196193 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.196346 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.196487 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.196646 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.196761 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.197009 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.197159 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.197372 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.197570 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.197755 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.197910 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.198120 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.198302 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.198449 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.198623 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.198831 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.199012 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.199201 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.199388 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.199584 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.199766 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-6-iscsi {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.199921 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-6-iscsi {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.200208 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.200386 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.200561 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.200561 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.200942 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.200942 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.201298 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.201298 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.201631 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.201774 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.201928 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.202056 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.202299 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.202435 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.202582 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.202702 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.202830 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.202958 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203085 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203235 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203368 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203496 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203625 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203753 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203873 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.203992 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.204111 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.204246 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.204375 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.204497 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.204644 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.204763 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.204910 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205169 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205288 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205406 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205535 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205654 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205861 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.205991 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.206112 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.206241 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.206361 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.206490 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.206619 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.206744 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.206912 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207053 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207213 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207349 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207471 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207605 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207726 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207849 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.207990 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.208113 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.208232 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.208357 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.208475 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.208594 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.208748 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.208878 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.209115 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.209304 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.209436 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.209576 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.209709 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.209830 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.209951 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.210076 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.210290 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.210486 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.210625 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.210752 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.210883 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.211012 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.211174 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.211304 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.211498 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.211675 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.211807 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.211941 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.212101 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.212245 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.212407 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.212563 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.212725 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.212855 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.213095 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.213276 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.213423 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.213548 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.213670 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.213790 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.214003 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.214179 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.214309 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.214445 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.214568 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.214688 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.214878 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.215009 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.215170 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.215295 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.215503 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.215632 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.215834 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.215976 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.216105 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.216226 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.216345 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.216464 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.216657 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.216785 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.216998 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.217128 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.217301 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.217444 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.217621 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.217772 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.217906 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.218026 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.218214 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.218351 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.218510 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.218644 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.218825 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.218952 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.219116 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.219257 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.219426 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.219558 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.219732 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.219858 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.220030 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.220167 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.220336 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.220469 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.220639 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.220765 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.220939 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.221088 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.221238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.221376 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.221554 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.221687 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.221871 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.222000 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.222175 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.222310 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.222485 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.222630 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.222761 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.222884 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.223075 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.223203 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.223378 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.223515 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.223664 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.223799 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.223980 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.224106 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.224279 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.224405 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.224573 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.224701 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.224869 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.225019 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.225210 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.225348 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.225485 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.225605 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.225802 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.225929 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.226108 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.226233 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.226369 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.226503 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.226691 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.226818 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.226995 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.227120 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.227304 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.227437 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.227612 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.227746 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.227895 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.228029 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.228201 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.228326 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.228504 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.228631 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.228799 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.228970 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.229101 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.229222 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.229409 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.229536 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.229709 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.229845 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.230019 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.230158 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.230334 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.230460 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.230652 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.230788 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.230938 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.231065 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.231289 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.231415 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.231613 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.231824 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.231947 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.232066 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:41:28.232269 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.232395 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.232596 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.232721 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.232943 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.233070 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.233267 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.233395 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.233585 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.233718 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.233922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.234020 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.234218 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.234316 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.234531 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.234639 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.234845 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.234935 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.235153 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.235251 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.235463 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.235562 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.235782 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.235869 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.236095 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.236197 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.236408 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.236506 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.236723 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.236812 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.237066 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.237168 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.237389 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.237553 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.237713 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.237854 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.238021 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.238172 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.238332 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.238490 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.238654 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.238794 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.238973 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.239122 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.239288 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.239436 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.239601 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.239740 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.239943 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.240094 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.240261 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.240411 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.240587 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.240736 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.240926 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.241074 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.241242 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.241385 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.241556 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.241695 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.241865 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.242018 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.242175 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.242316 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.242502 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.242644 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.242812 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.242952 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.243124 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.243273 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.243417 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.243549 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.243736 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.243877 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.244050 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.244199 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.244359 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.244526 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.244663 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.244795 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.244993 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.245135 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.245281 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.245424 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.245588 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.245728 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.245903 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.246051 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.246226 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.246387 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.246524 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.246657 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.246853 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.246996 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.247172 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.247321 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.247491 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.247632 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.247803 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.247944 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.248112 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.248260 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.248408 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.248550 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.248690 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.248824 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.249001 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.249138 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.249317 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.249458 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.249620 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.249761 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.249904 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.250038 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.250227 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.250380 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.250543 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.250684 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.250849 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.250997 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.251168 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.251316 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.251475 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.251615 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.251780 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.251920 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.252089 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.252228 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.252375 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.252516 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.252683 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.252832 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.253034 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.253177 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.253343 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.253492 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.253666 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.253815 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.253976 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.254117 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.254279 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.254512 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.254650 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.254784 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.254924 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.255057 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.255197 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.255339 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.255472 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.255605 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.255766 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.255908 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.256053 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.256198 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.256365 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.256506 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.256673 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.256811 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.257011 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.257155 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.257319 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.257472 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.257633 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.257774 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.257923 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.258057 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.258259 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.258409 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.258569 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.258709 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.258880 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.259020 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.259200 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.259340 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.259514 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.259664 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.259798 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.259939 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.260108 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.260259 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.260393 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.260535 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.260697 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.260839 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.261004 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.261139 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.261314 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.261468 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.261603 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.261735 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.261906 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.262047 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.262191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.262338 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.262526 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.262666 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.262856 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.262998 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.263177 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.263320 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.263484 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.263637 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.263779 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.263912 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.264063 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.264206 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.264349 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.264483 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.264651 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.264791 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.264999 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.265147 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.265312 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.265458 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.265643 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.265783 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.265960 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.266113 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.266276 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.266416 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.266584 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.266733 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.266900 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.267046 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.267208 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.267355 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.267524 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.267678 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.267836 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.267975 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.268142 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.268282 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.268449 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.268598 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.268755 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.268924 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.269096 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.269245 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.269388 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.269537 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.269710 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.269860 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.270019 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.270172 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.270321 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.270456 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.270626 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.270772 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.270913 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.271046 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.271226 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.271367 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.271564 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.271705 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.271877 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.272024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.272198 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.272340 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.272507 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.272660 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.272816 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.273020 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.273168 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.273302 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.273435 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.273567 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.273735 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.273875 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.274033 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.274168 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.274337 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.274476 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.274642 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.274796 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.274939 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.275071 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.275245 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.275443 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.275579 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.275721 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.275858 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.276010 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.276146 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.276278 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.276437 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.276635 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.276788 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.276950 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.277091 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.277235 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.277378 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.277519 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.277699 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.277840 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.278007 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.278147 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.278351 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.278491 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.278661 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.278801 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.278969 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.279120 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.279272 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.279411 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.279567 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.279707 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.279870 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.280021 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.280164 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.280299 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.280475 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.280624 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.280770 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.280951 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.281105 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.281240 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.281373 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.281512 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.281689 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.281839 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.281986 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.282131 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.282286 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.282436 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.282570 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.282783 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.282920 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.283055 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.283195 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.283329 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.283461 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.283602 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.283773 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.283915 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.284090 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.284231 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.284393 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.284543 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.284679 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.284820 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.285003 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.285139 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.285331 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.285482 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.285625 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.285769 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.285903 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.286035 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.286197 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.286348 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.286484 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.286616 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.286825 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.286967 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.287131 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.287272 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.287427 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.287560 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.287741 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.287882 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.288055 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.288195 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.288360 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.288940 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.289094 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.289245 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.289391 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.289532 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.289666 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.289797 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.289930 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.290088 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.290232 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.290365 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.290536 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.290687 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.290821 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.290960 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.291125 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.291272 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.291432 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.291572 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.291737 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.291896 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.292053 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.292193 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.292356 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.292496 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.292663 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.292816 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.293013 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.293158 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.293301 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.293433 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.293580 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.293714 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.293974 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.294216 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.294549 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.294689 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.294864 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.295006 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.295181 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.295320 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.295507 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.295650 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.295831 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.295984 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.296161 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.296331 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.296489 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.296630 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.296802 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.296988 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.297139 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.297288 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.297431 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.297565 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.297729 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.297871 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.298035 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.298192 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.298326 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.298458 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.298636 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.298778 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.298930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.299064 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.299229 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.299369 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.299513 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.299653 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.299825 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.299975 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.300123 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.300255 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.300415 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.300564 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.300700 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.300832 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.301032 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.301186 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.301321 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.301461 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.301641 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.301790 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.301924 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.302078 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.302213 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.302362 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.302536 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.302691 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.302825 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.302956 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.303122 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.303363 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.303503 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.303638 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.303771 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.303910 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.304065 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.304199 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.304342 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.304474 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.304655 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.304809 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.305019 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.305188 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.305337 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.305436 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.305653 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.305788 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.305937 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.306035 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.306277 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.306430 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.306553 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.306736 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.306858 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.306952 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.307185 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.307318 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.307489 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.307640 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.307806 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.307901 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.308091 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.308225 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.308368 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.308476 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.308698 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.308830 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.308991 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.309082 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.309315 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.309469 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.309646 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.309784 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.309948 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.310082 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.310226 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.310335 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.310553 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.310687 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.310837 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.310930 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.311139 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.311231 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.311426 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.311575 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.311724 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.311868 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.312011 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.312146 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.312287 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.312421 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.312592 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.312733 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.312930 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.313074 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.313208 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.313340 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.313509 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.313667 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.313821 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.313954 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.314100 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.314248 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.314383 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.314531 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.314666 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.314798 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.314973 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.315113 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.315285 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.315433 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.315589 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.315724 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.315865 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.315998 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.316171 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.316321 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.316464 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.316597 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.316757 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.316923 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.317087 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.317239 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.317405 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.317568 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.317705 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.317836 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.318008 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.318157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.318314 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.318455 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.318615 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.318757 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.318899 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.319032 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.319201 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.319342 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.319492 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.319625 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.319790 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.319933 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.320077 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.320217 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.320360 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.320503 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.320660 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.320802 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.320975 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.321114 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.321326 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.321493 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.321630 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.321763 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.321896 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.322028 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.322160 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.322301 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.322435 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.322568 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.322753 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.322892 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.323057 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.323215 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.323381 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.323530 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.323706 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.323856 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.324001 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.324135 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.324318 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.324458 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.324627 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.324768 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.324995 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.325143 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.325298 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.325433 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.325605 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.325747 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.325919 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.326069 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.326228 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.326368 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.326535 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.326674 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.326837 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.326977 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.327138 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.327291 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.327447 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.327588 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.327755 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.327905 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.328047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.328181 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.328362 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.328518 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.328681 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.328827 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.329013 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.329156 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.329308 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.329456 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.329597 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.329736 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.329906 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.330054 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.330194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.330349 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.330491 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.330637 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.330781 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.330921 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.331090 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.331257 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.331400 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.331539 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.331726 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.331870 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.332020 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.332162 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.332301 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.332443 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.332590 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.332731 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.332879 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.333081 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.333224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.333371 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.333512 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.333651 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.333841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.333986 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.334126 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.334265 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.334411 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.334552 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.334774 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.334918 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.335076 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.335217 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.335365 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.335514 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.335654 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.335793 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.335932 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.336070 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.336210 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.336357 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.336497 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.336637 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.336783 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.336985 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.337151 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.337301 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.337442 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.337582 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.337721 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.337860 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.338000 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.338152 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.338299 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.338440 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.338636 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.338805 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.338966 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.339107 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.339280 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.339428 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.339568 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.339708 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.339856 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.339997 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.340144 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.340284 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.340449 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.340620 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.340839 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.341030 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.341173 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.341313 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.341452 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.341591 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.341739 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.341882 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.342051 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.342209 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.342351 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.342498 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.342647 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.342798 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.342976 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.343122 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.343353 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.343642 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.343785 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.343925 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.344065 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.344203 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.344342 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.344489 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.344631 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.344770 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.345014 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.345243 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.345387 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.345527 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.345666 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.345821 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.345962 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.346102 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.346242 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.346388 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.346528 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.346676 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.346828 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.346968 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.347108 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.347254 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.347404 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.347552 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.347692 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.347831 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.347969 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.348109 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.348258 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.348400 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.348577 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.348757 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.348929 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.349078 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.349230 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.349381 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.349578 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.349724 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.349922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.350076 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.350227 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.350367 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.350536 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.350685 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.350861 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.351034 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.351180 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.351330 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.351471 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.351611 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.351758 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.351908 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.352049 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.352188 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.352328 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.352467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.352633 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.352800 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.352982 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.353126 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.353266 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.353406 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.353545 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.353697 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.353837 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.353985 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.354125 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.354263 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.354412 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.354577 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.354719 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.354859 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.354998 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.355137 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.355300 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.355450 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.355592 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.355732 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.355913 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.356060 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.356277 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.356429 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.356581 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.356722 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.356913 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.357065 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.357218 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.357366 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.357515 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.357662 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.357802 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.357959 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.358100 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.358240 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.358415 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.358576 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.358726 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.358880 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.359023 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.359161 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.359340 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.359488 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.359669 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.359831 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.359973 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.360113 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.360288 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.360448 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.360611 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.360768 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.360960 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.361110 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.361260 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.361400 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.361552 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.361694 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.361879 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.362039 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.362182 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.362322 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.362482 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.362624 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.362764 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.362905 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.363046 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.363185 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.363337 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.363478 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.363618 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.363774 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.363922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.364070 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.364220 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.364379 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.364520 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.364660 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.364799 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.365003 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.365159 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.365309 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.365450 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.365589 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.365738 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.365888 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.366031 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.366171 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.366321 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.366461 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.366601 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.366749 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.366891 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.367032 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.367206 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.367352 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.367501 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.367650 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.367827 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.367975 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.368127 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.368267 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.368443 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.368593 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.368743 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.368909 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.369081 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.369230 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.369384 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.369527 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.369692 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.369840 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.370005 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.370162 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.370314 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.370455 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.370595 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.370735 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.370900 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.371049 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.371199 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.371347 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.371511 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.371659 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.371850 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.372009 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.372163 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.372420 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.372715 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.372873 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.373080 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.373300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.373453 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.373593 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.373733 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.373879 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.374020 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.374177 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.374335 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.374476 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.374615 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.374755 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.374895 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.375044 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.375185 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.375325 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.375466 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.375605 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.375754 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.375895 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.376043 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.376202 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.376371 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.376528 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.376679 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.376827 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.377033 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.377180 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.377357 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.377518 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.377660 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.377799 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.377971 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.378136 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.378279 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.378432 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.378620 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.378767 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.379052 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.379221 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.379378 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.379519 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.379659 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.379827 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.379974 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.380124 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.380266 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.380406 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.380552 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.380715 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.380878 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.381090 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.381232 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.381372 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.381511 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.381666 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.381841 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.381985 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.382125 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.382273 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.382415 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.382554 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.382704 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.382858 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.383007 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.383148 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.383296 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.383436 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.383594 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.383743 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.383885 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.384024 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.384163 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.384349 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.384539 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.389174 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.389400 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.389563 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.389714 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.389870 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.390041 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.390204 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.390348 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.390490 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.390632 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.390786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.390928 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.391069 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.391216 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.391366 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.391508 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.391656 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.391797 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.391949 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.392089 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.392243 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.392392 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.392540 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.392680 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.392827 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.393001 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.393153 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.393313 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.393472 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.393611 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.393751 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.393901 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.394042 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.394197 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.394197 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.394466 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.394466 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.394732 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.394879 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.395033 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.395182 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.395323 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.395463 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.395614 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.395768 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.395922 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.396070 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.396213 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.396354 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.396494 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.396642 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.396782 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.396940 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.397103 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.397245 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.397385 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.397543 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.397684 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.397824 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.397964 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.398102 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.398242 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.398391 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.398534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.398681 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.398822 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.398961 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.399109 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.399256 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.399407 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.399548 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.399688 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.399827 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.399975 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.400115 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.400261 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.400408 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.400550 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.400690 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.400839 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.401038 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.401181 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.401343 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.401492 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.401633 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.401785 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.401927 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402066 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402213 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402352 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402499 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402667 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402776 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402859 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.402939 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403019 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403110 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403199 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403279 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403358 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403437 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403515 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403603 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403603 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403750 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403750 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403909 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.403990 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404153 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404153 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404296 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404365 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404438 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404515 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404583 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404583 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404718 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404785 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404851 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.404851 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405040 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405110 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405183 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405251 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405316 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405316 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405445 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405520 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405588 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405588 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405725 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405802 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405899 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.405973 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406040 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406105 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406199 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406271 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406349 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406518 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406603 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406843 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.406999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.407127 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.407213 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.407472 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.407592 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.407783 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.408022 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.408126 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.408217 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.408383 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.408516 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.408700 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.408834 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.409025 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.409158 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.409330 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.409465 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.409612 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.409712 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.409940 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.410074 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.410248 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.410381 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.410556 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.410690 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.410861 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.410996 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.411151 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.411310 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.411455 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.411547 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.411756 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.411847 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.412070 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.412172 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.412387 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.412477 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.412709 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.412809 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.413036 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.413147 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.413344 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.413800 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.414016 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.414108 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.414324 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.414424 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.414629 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.414719 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.414938 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.415029 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.415245 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.415336 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.415558 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.415658 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.415853 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.415951 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.416189 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.416491 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.416582 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.416850 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.417192 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.417281 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.417519 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.417619 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.417826 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.417914 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.418146 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.418242 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.418459 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.418546 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.418815 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.418957 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.419137 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.419241 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.419447 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.419544 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.419774 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.419904 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.420101 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.420198 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.420428 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.420522 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.420751 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.420840 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.421082 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.421173 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.421386 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.421481 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.421691 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.421788 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.421999 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.422088 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.422303 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.422390 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.422611 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.422712 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.422915 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.423014 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.423215 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.423302 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.423518 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.423615 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.423818 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.423912 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.424118 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.424212 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.424419 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.424519 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.424720 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.424819 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.425049 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.425137 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.425354 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.425474 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.425661 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.425759 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.425959 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.426046 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.426256 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.426356 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.426557 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.426651 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.426853 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.426939 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.427157 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.427246 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.427458 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.427558 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.427762 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.427866 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.428060 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.428148 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.428358 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.428451 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.428658 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.428745 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.428981 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.429111 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.429288 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.429389 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.429652 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.429746 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.429962 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.430052 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.430254 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.430349 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.430573 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.430747 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.430880 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.430968 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.431198 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.431284 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.431509 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.431605 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.431822 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.431908 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.432127 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.432215 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.432439 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.432538 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.432748 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.432834 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.433083 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.433181 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.433392 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.433490 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.433701 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.433789 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.434008 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.434111 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.434338 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.434450 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.434656 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.434748 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.434968 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.435055 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.435269 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.435357 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.435592 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.435679 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.435900 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.435993 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.436214 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.436301 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.436525 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.436659 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.436833 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.436981 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.437181 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.437268 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.437492 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.437578 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.437804 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.437929 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.438110 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.438207 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.438418 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.438520 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.438723 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.438827 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.439031 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.439133 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.439334 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.439426 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.439640 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.439743 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.439945 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.440055 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.440255 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.440359 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.440571 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.440673 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.440911 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.441008 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.441219 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.441312 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.441543 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.441638 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.441848 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.441940 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.442172 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.442279 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.442493 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.442586 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.442832 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.442925 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.443145 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.443247 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.443457 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.443551 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.443766 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.443869 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.444073 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.444176 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.444317 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:41:28.444421 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.444696 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:41:28.444963 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:41:28.601273 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO dbcounter [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Registered counter for database nova_api Sep 13 19:41:28.602001 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO dbcounter [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Registered counter for database nova_api Sep 13 19:41:28.621785 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_db.sqlalchemy.engines [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.624662 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_db.sqlalchemy.engines [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.628635 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writer thread running {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:28.632808 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writer thread running {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:28.689208 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.context [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50830944-793d-4e46-b527-41f92d9eef04(cell1) {{(pid=117103) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:41:28.691345 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.context [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50830944-793d-4e46-b527-41f92d9eef04(cell1) {{(pid=117104) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:41:28.693303 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:41:28.693846 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:41:28.695305 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_concurrency.lockutils [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:41:28.695460 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:41:28.695780 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_concurrency.lockutils [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:41:28.696273 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:41:28.696708 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:41:28.697398 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_concurrency.lockutils [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:41:28.698132 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_concurrency.lockutils [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:41:28.698575 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_concurrency.lockutils [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:41:28.698707 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:41:28.700558 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_concurrency.lockutils [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:41:28.701273 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO dbcounter [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Registered counter for database nova_cell0 Sep 13 19:41:28.702782 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO dbcounter [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Registered counter for database nova_cell0 Sep 13 19:41:28.705432 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO dbcounter [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Registered counter for database nova_cell1 Sep 13 19:41:28.707025 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO dbcounter [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Registered counter for database nova_cell1 Sep 13 19:41:28.713125 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_db.sqlalchemy.engines [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.716479 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_db.sqlalchemy.engines [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.717155 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_db.sqlalchemy.engines [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.719490 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writer thread running {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:28.720201 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_db.sqlalchemy.engines [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.723239 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writer thread running {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:28.854626 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writer thread running {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:28.860438 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writer thread running {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:28.864707 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO dbcounter [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Registered counter for database nova_cell0 Sep 13 19:41:28.870987 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO dbcounter [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Registered counter for database nova_cell0 Sep 13 19:41:28.873969 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_db.sqlalchemy.engines [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.879367 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writer thread running {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:28.880137 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG oslo_db.sqlalchemy.engines [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:41:28.885394 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writer thread running {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:41:29.210484 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: WARNING keystonemiddleware.auth_token [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:41:29.216443 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: WARNING keystonemiddleware.auth_token [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:41:29.218046 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: WARNING keystonemiddleware.auth_token [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:41:29.223796 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: WARNING keystonemiddleware.auth_token [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:41:29.559497 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: WARNING keystonemiddleware.auth_token [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:41:29.566144 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: WARNING keystonemiddleware.auth_token [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:41:29.569559 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: WARNING keystonemiddleware.auth_token [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:41:29.571457 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608a06219c0 pid: 117103 (default app) Sep 13 19:41:29.573557 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:41:29.574747 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001768 Sep 13 19:41:29.575462 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Sep 13 19:41:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:41:29.575714 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: WARNING keystonemiddleware.auth_token [None req-1daa2bd1-d5eb-4626-9127-e1d1bcb37d99 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:41:29.581153 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608a06219c0 pid: 117104 (default app) Sep 13 19:42:53.562747 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:53.563731 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 13 19:42:53.564116 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:42:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:53.581835 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_api:SELECT=3 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:53.583737 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_cell0:SELECT=3 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:53.584471 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_cell1:SELECT=3 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:53.585317 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.567925 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-953121bd-d62c-44f1-84df-dc8fe5c979aa admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:54.605766 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-953121bd-d62c-44f1-84df-dc8fe5c979aa admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.034035 Sep 13 19:42:54.606969 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 19:42:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:42:57.322940 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:42:57.324636 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-c4f9db25-48ac-45c3-93e2-c135ab4cedae None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Sep 13 19:42:57.325321 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:42:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:42:57.790173 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-26b2e9c6-a6c8-4151-be9f-981909926f6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "ram": 256, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:57.845089 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-26b2e9c6-a6c8-4151-be9f-981909926f6c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.513085 Sep 13 19:42:57.845676 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:42:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:42:57.860156 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_api:SELECT=3 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.861042 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_cell0:SELECT=3 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.862063 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_cell1:SELECT=3 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.862795 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:58.067789 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-9fb99ad7-4a54-4ba2-a7cf-f5592aab572d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:42:58.137584 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-9fb99ad7-4a54-4ba2-a7cf-f5592aab572d admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282945 Sep 13 19:42:58.138182 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 19:42:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:00.743535 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-26b2e9c6-a6c8-4151-be9f-981909926f6c admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:00.744856 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-26b2e9c6-a6c8-4151-be9f-981909926f6c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001838 Sep 13 19:43:00.745352 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:43:01.435903 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-143d8e28-4a19-46e2-bfe7-ef12de4d6212 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:01.478748 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-143d8e28-4a19-46e2-bfe7-ef12de4d6212 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.725421 Sep 13 19:43:01.479489 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:43:01.493272 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-4e0532fb-98d9-449b-9034-2d1eec5812cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:01.538513 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-4e0532fb-98d9-449b-9034-2d1eec5812cc admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049557 Sep 13 19:43:01.539381 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 19:43:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:04.138698 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-143d8e28-4a19-46e2-bfe7-ef12de4d6212 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:04.139756 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-143d8e28-4a19-46e2-bfe7-ef12de4d6212 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 13 19:43:04.140179 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:04.579374 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-5b44ef6d-d24a-4b55-adba-ce7d306ebf52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:04.600652 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-5b44ef6d-d24a-4b55-adba-ce7d306ebf52 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453441 Sep 13 19:43:04.601715 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:04.613649 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-b99d8f4d-607e-4283-8031-a737f3f845f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:04.651022 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-b99d8f4d-607e-4283-8031-a737f3f845f3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040853 Sep 13 19:43:04.652232 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 19:43:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:07.465486 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-5b44ef6d-d24a-4b55-adba-ce7d306ebf52 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:07.466470 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-5b44ef6d-d24a-4b55-adba-ce7d306ebf52 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Sep 13 19:43:07.466880 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:07.913273 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-4cea8594-e389-4a3c-a7b7-ab71302cd089 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3", "vcpus": 2}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:07.936499 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-4cea8594-e389-4a3c-a7b7-ab71302cd089 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462947 Sep 13 19:43:07.937564 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:07.950161 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-c78ff3fb-e37a-4ae1-aaff-0fa7e10201a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:07.979188 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-c78ff3fb-e37a-4ae1-aaff-0fa7e10201a5 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033002 Sep 13 19:43:07.979829 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 19:43:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:10.759412 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-4cea8594-e389-4a3c-a7b7-ab71302cd089 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:10.761049 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-4cea8594-e389-4a3c-a7b7-ab71302cd089 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002263 Sep 13 19:43:10.761686 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:11.239146 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-0535cf72-8646-4a90-bda7-c67fccc420b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:11.261407 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-0535cf72-8646-4a90-bda7-c67fccc420b0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491625 Sep 13 19:43:11.262254 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:43:11.278647 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-38521e2e-2e1a-4fe9-95f1-63b1d56e59b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:11.305432 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-38521e2e-2e1a-4fe9-95f1-63b1d56e59b0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032723 Sep 13 19:43:11.306034 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1336 bytes} [Tue Sep 13 19:43:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:14.015796 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-0535cf72-8646-4a90-bda7-c67fccc420b0 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:14.017470 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-0535cf72-8646-4a90-bda7-c67fccc420b0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002198 Sep 13 19:43:14.017888 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:14.459425 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-f3406316-5be1-4f55-b906-98e7d10c932f admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:14.494933 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-f3406316-5be1-4f55-b906-98e7d10c932f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.469618 Sep 13 19:43:14.495904 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 19:43:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:17.130979 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-0535cf72-8646-4a90-bda7-c67fccc420b0 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:17.132018 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-0535cf72-8646-4a90-bda7-c67fccc420b0 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 13 19:43:17.132432 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:17.549840 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-854f264a-dce0-4de7-aff9-0b5813392cc4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:17.570639 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-854f264a-dce0-4de7-aff9-0b5813392cc4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.431531 Sep 13 19:43:17.571192 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:17.583833 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-9c3ab2a6-53f9-45c7-88c8-a9c6bd1eaab7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:17.613766 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-9c3ab2a6-53f9-45c7-88c8-a9c6bd1eaab7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033525 Sep 13 19:43:17.614334 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 19:43:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:20.208293 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-854f264a-dce0-4de7-aff9-0b5813392cc4 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:20.209358 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-854f264a-dce0-4de7-aff9-0b5813392cc4 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 13 19:43:20.209769 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:20.591983 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-f50dc063-401f-46d9-a6cc-5ac46c6aa3c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:20.612963 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-f50dc063-401f-46d9-a6cc-5ac46c6aa3c8 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.396862 Sep 13 19:43:20.613533 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:20.625560 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-89716c35-474d-4973-b899-e55b996c287b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:20.652477 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-89716c35-474d-4973-b899-e55b996c287b admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030586 Sep 13 19:43:20.653096 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 19:43:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:23.330486 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-f50dc063-401f-46d9-a6cc-5ac46c6aa3c8 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:23.331517 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-f50dc063-401f-46d9-a6cc-5ac46c6aa3c8 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 13 19:43:23.332093 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:23.874753 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-33fda309-693d-4190-b5eb-76d090753289 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:23.904626 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-33fda309-693d-4190-b5eb-76d090753289 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.565449 Sep 13 19:43:23.908475 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:23.917149 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-c9a86faf-19eb-45c3-8c77-9116e36a0133 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:23.923798 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.950623 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-c9a86faf-19eb-45c3-8c77-9116e36a0133 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037112 Sep 13 19:43:23.951557 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 19:43:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:27.341586 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-33fda309-693d-4190-b5eb-76d090753289 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:27.342893 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-33fda309-693d-4190-b5eb-76d090753289 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Sep 13 19:43:27.343607 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:43:27.982590 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-0e85cb5a-9de6-4d64-bcd7-de58e4e2af72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:28.005714 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-0e85cb5a-9de6-4d64-bcd7-de58e4e2af72 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.655282 Sep 13 19:43:28.006275 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:28.021356 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-da4008bd-0424-486d-b2d6-9bf3f8c68a3f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:28.053306 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-da4008bd-0424-486d-b2d6-9bf3f8c68a3f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036455 Sep 13 19:43:28.056932 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 19:43:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:31.150272 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-0e85cb5a-9de6-4d64-bcd7-de58e4e2af72 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:31.152412 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-0e85cb5a-9de6-4d64-bcd7-de58e4e2af72 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002508 Sep 13 19:43:31.157441 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:31 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:43:31.666344 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-f61977d1-8b30-4689-aa61-3fc6b0a0212f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "vcpus": 8, "swap": 0, "name": "m1.xlarge"}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:31.674936 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.707348 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-f61977d1-8b30-4689-aa61-3fc6b0a0212f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.546054 Sep 13 19:43:31.716985 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1283 bytes} [Tue Sep 13 19:43:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:43:31.724220 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-171b4396-b1a5-491f-aae0-5b8297422dbd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:31.759006 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-171b4396-b1a5-491f-aae0-5b8297422dbd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039747 Sep 13 19:43:31.759837 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1333 bytes} [Tue Sep 13 19:43:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:48.717864 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-f61977d1-8b30-4689-aa61-3fc6b0a0212f admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:48.718785 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-f61977d1-8b30-4689-aa61-3fc6b0a0212f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 13 19:43:48.719200 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:48.731113 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.270867 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-8f1e87e2-646f-48b2-8dfa-4ccb8f3428f5 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:49.291206 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-8f1e87e2-646f-48b2-8dfa-4ccb8f3428f5 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.564862 Sep 13 19:43:49.291796 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 19:43:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:50.741995 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-f61977d1-8b30-4689-aa61-3fc6b0a0212f admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:50.743015 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-f61977d1-8b30-4689-aa61-3fc6b0a0212f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 13 19:43:50.743416 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:43:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:43:51.339388 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-3d21c42b-2713-4a53-92ec-3d3b4ea6927e admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:51.345211 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.wsgi [None req-3d21c42b-2713-4a53-92ec-3d3b4ea6927e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-3d21c42b-2713-4a53-92ec-3d3b4ea6927e admin admin] Request method failure captured: Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Accept: application/json Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Accept-Encoding: gzip, deflate Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Connection: keep-alive Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Content-Length: 0 Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Host: 10.222.0.18 Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Openstack-Api-Version: compute 2.92 Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Openstack-System-Scope: None Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: User-Agent: python-novaclient Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Auth-Token: gAAAAABjIN12VPfwRlA2WWlVq-DMlcR6LbAhLTxKpIxvitmFsrvKku1P--irltq4WtCdEwpz2XkNEODopH2kVVJdKOlcZz_9mG4XKpXATWWJYtM_QZ7_VIAb3FSx9KPrk1WlU223h6Lznca-o5-XhUBQ7cxDEeX-K53QJajXMwWfN5N8cvbn4yU Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Domain-Id: None Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Domain-Name: None Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Identity-Status: Confirmed Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Is-Admin-Project: True Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Domain-Id: default Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Domain-Name: Default Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Name: admin Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Role: member,reader,admin Sep 13 19:43:51.348534 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Roles: member,reader,admin Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af00e3aad1ad462b983823ea889f0033", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}] Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant: admin Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant-Name: admin Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User: admin Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Domain-Id: default Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Domain-Name: Default Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Id: cc92c723f30741629d9940fdc108b101 Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Name: admin Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: method: > Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: exception: Flavor 42 could not be found. Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: action_args: {'id': '42'} Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:43:51.350157 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:51.350999 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.352191 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-3d21c42b-2713-4a53-92ec-3d3b4ea6927e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:43:51.353309 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-3d21c42b-2713-4a53-92ec-3d3b4ea6927e admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.470045 Sep 13 19:43:51.353309 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 19:43:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:51.361457 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-87d3d0c6-1895-4140-8732-05678a4fcccc admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:51.387186 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-87d3d0c6-1895-4140-8732-05678a4fcccc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029711 Sep 13 19:43:51.387756 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 19:43:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:51.402694 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-2a04afd7-a8da-46c5-b792-959a7b2f2398 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:51.426998 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-2a04afd7-a8da-46c5-b792-959a7b2f2398 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029377 Sep 13 19:43:51.427556 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 19:43:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:51.441480 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-e78b8ed7-d69a-4f7b-9b03-62678a7ea00a admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:51.447324 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.wsgi [None req-e78b8ed7-d69a-4f7b-9b03-62678a7ea00a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-e78b8ed7-d69a-4f7b-9b03-62678a7ea00a admin admin] Request method failure captured: Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Accept: application/json Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Accept-Encoding: gzip, deflate Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Connection: keep-alive Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Content-Length: 0 Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Host: 10.222.0.18 Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Openstack-Api-Version: compute 2.92 Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Openstack-System-Scope: None Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: User-Agent: python-novaclient Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Auth-Token: gAAAAABjIN12VPfwRlA2WWlVq-DMlcR6LbAhLTxKpIxvitmFsrvKku1P--irltq4WtCdEwpz2XkNEODopH2kVVJdKOlcZz_9mG4XKpXATWWJYtM_QZ7_VIAb3FSx9KPrk1WlU223h6Lznca-o5-XhUBQ7cxDEeX-K53QJajXMwWfN5N8cvbn4yU Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Domain-Id: None Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Domain-Name: None Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Identity-Status: Confirmed Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Is-Admin-Project: True Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Domain-Id: default Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Domain-Name: Default Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Name: admin Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Role: member,reader,admin Sep 13 19:43:51.450752 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Roles: member,reader,admin Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af00e3aad1ad462b983823ea889f0033", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}] Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant: admin Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant-Name: admin Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User: admin Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Domain-Id: default Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Domain-Name: Default Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Id: cc92c723f30741629d9940fdc108b101 Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Name: admin Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: method: > Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: exception: Flavor 42 could not be found. Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: action_args: {'id': '42'} Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:43:51.453194 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:51.454930 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:51.457238 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-e78b8ed7-d69a-4f7b-9b03-62678a7ea00a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:43:51.459698 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-e78b8ed7-d69a-4f7b-9b03-62678a7ea00a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015491 Sep 13 19:43:51.459698 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 19:43:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:52.797455 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-2a04afd7-a8da-46c5-b792-959a7b2f2398 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:52.799219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-2a04afd7-a8da-46c5-b792-959a7b2f2398 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002560 Sep 13 19:43:52.799903 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:43:52 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:53.555477 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-28b61185-bda5-46e2-bef1-a3eea503da76 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:53.562190 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.wsgi [None req-28b61185-bda5-46e2-bef1-a3eea503da76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-28b61185-bda5-46e2-bef1-a3eea503da76 admin admin] Request method failure captured: Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Accept: application/json Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Accept-Encoding: gzip, deflate Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Connection: keep-alive Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Content-Length: 0 Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Host: 10.222.0.18 Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Openstack-Api-Version: compute 2.92 Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Openstack-System-Scope: None Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: User-Agent: python-novaclient Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Auth-Token: gAAAAABjIN14ajn_j-9bA4KDGqQoScGGuoXONj_tufkUuGjFzShhrrMOgrP3yLOhWh69B100aXX6vvoX9Fx1UGD8YiqwCTGemD75loH2g-QVZbgZ8M0sQKoNXhTe4pyfrZiY7Ey8Lqb2zLqjpLnbkOHYqWDaujII1uNbVA7ZppEN44UaBQedx1M Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Domain-Id: None Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Domain-Name: None Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Identity-Status: Confirmed Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Is-Admin-Project: True Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Domain-Id: default Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Domain-Name: Default Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Name: admin Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Role: member,reader,admin Sep 13 19:43:53.564047 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Roles: member,reader,admin Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af00e3aad1ad462b983823ea889f0033", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}] Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant: admin Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant-Name: admin Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User: admin Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Domain-Id: default Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Domain-Name: Default Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Id: cc92c723f30741629d9940fdc108b101 Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Name: admin Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: method: > Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: exception: Flavor 84 could not be found. Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: action_args: {'id': '84'} Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:43:53.565923 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:53.566922 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.568092 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-28b61185-bda5-46e2-bef1-a3eea503da76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:43:53.569959 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-28b61185-bda5-46e2-bef1-a3eea503da76 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.624046 Sep 13 19:43:53.569959 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 19:43:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 625 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:53.579158 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-2f9cd455-20f2-41e8-870e-36803d5515a9 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:53.596285 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-2f9cd455-20f2-41e8-870e-36803d5515a9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022434 Sep 13 19:43:53.597103 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 19:43:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:53.607598 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-cce481c2-7ce4-457a-8c6b-1307d9c23cee admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:53.624720 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-cce481c2-7ce4-457a-8c6b-1307d9c23cee admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020765 Sep 13 19:43:53.625341 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 19:43:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:53.642019 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-5052541d-c6d0-4cc3-9f82-992846287ac9 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:53.651163 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.wsgi [None req-5052541d-c6d0-4cc3-9f82-992846287ac9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-5052541d-c6d0-4cc3-9f82-992846287ac9 admin admin] Request method failure captured: Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Accept: application/json Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Accept-Encoding: gzip, deflate Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Connection: keep-alive Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Content-Length: 0 Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Host: 10.222.0.18 Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Openstack-Api-Version: compute 2.92 Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Openstack-System-Scope: None Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: User-Agent: python-novaclient Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Auth-Token: gAAAAABjIN14ajn_j-9bA4KDGqQoScGGuoXONj_tufkUuGjFzShhrrMOgrP3yLOhWh69B100aXX6vvoX9Fx1UGD8YiqwCTGemD75loH2g-QVZbgZ8M0sQKoNXhTe4pyfrZiY7Ey8Lqb2zLqjpLnbkOHYqWDaujII1uNbVA7ZppEN44UaBQedx1M Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Domain-Id: None Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Domain-Name: None Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Identity-Status: Confirmed Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Is-Admin-Project: True Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Domain-Id: default Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Domain-Name: Default Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Name: admin Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Role: member,reader,admin Sep 13 19:43:53.654467 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Roles: member,reader,admin Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af00e3aad1ad462b983823ea889f0033", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}] Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant: admin Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant-Name: admin Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User: admin Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Domain-Id: default Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Domain-Name: Default Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Id: cc92c723f30741629d9940fdc108b101 Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Name: admin Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: method: > Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: exception: Flavor 84 could not be found. Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: action_args: {'id': '84'} Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:43:53.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:53.656864 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:53.658300 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-5052541d-c6d0-4cc3-9f82-992846287ac9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:43:53.659612 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-5052541d-c6d0-4cc3-9f82-992846287ac9 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.021649 Sep 13 19:43:53.659612 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Sep 13 19:43:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:55.039898 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-cce481c2-7ce4-457a-8c6b-1307d9c23cee admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:55.041032 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-cce481c2-7ce4-457a-8c6b-1307d9c23cee admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 13 19:43:55.041458 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:43:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:55.672458 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-23a142c1-753f-40b9-a937-7ad738047d5b admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:55.679259 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.wsgi [None req-23a142c1-753f-40b9-a937-7ad738047d5b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-23a142c1-753f-40b9-a937-7ad738047d5b admin admin] Request method failure captured: Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Accept: application/json Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Accept-Encoding: gzip, deflate Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Connection: keep-alive Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Content-Length: 0 Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Host: 10.222.0.18 Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Openstack-Api-Version: compute 2.92 Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Openstack-System-Scope: None Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: User-Agent: python-novaclient Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Auth-Token: gAAAAABjIN16eWHrqUWwO7rspje3MsBMht1hL-cT6Y5i3nFqh4yGOXqL3bySESw0kFS_yQ6jyEAiQ5lYmSefSmbGv29TXXv0D1s6OeMKK9u_ZhDz5KhPGSYb2RHpqjgWkhZl4nBIvj1mC9wz0aahli22OoOkmpuRD4Hxu1qWL7RumtcYOkpkhlM Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Domain-Id: None Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Domain-Name: None Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Identity-Status: Confirmed Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Is-Admin-Project: True Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Domain-Id: default Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Domain-Name: Default Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Project-Name: admin Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Role: member,reader,admin Sep 13 19:43:55.680841 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Roles: member,reader,admin Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af00e3aad1ad462b983823ea889f0033", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}] Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant: admin Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-Tenant-Name: admin Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User: admin Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Domain-Id: default Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Domain-Name: Default Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Id: cc92c723f30741629d9940fdc108b101 Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: X-User-Name: admin Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: method: > Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: exception: Flavor 451 could not be found. Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: action_args: {'id': '451'} Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:43:55.683219 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:55.684599 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.686500 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-23a142c1-753f-40b9-a937-7ad738047d5b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:43:55.688313 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-23a142c1-753f-40b9-a937-7ad738047d5b admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.489316 Sep 13 19:43:55.688313 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 19:43:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 491 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:55.705115 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-2cea6f6c-1bd3-49d2-b483-aa9431929325 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:55.735456 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-2cea6f6c-1bd3-49d2-b483-aa9431929325 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.036561 Sep 13 19:43:55.736443 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 19:43:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:43:55.750386 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:55.770248 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023768 Sep 13 19:43:55.770850 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Sep 13 19:43:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:43:55.782635 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-adc4a9c7-b290-4240-b90e-d14942cfb1ba admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:55.788603 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.wsgi [None req-adc4a9c7-b290-4240-b90e-d14942cfb1ba admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-adc4a9c7-b290-4240-b90e-d14942cfb1ba admin admin] Request method failure captured: Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Accept: application/json Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Accept-Encoding: gzip, deflate Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Connection: keep-alive Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Content-Length: 0 Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Host: 10.222.0.18 Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Openstack-Api-Version: compute 2.92 Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Openstack-System-Scope: None Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: User-Agent: python-novaclient Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Auth-Token: gAAAAABjIN16eWHrqUWwO7rspje3MsBMht1hL-cT6Y5i3nFqh4yGOXqL3bySESw0kFS_yQ6jyEAiQ5lYmSefSmbGv29TXXv0D1s6OeMKK9u_ZhDz5KhPGSYb2RHpqjgWkhZl4nBIvj1mC9wz0aahli22OoOkmpuRD4Hxu1qWL7RumtcYOkpkhlM Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Domain-Id: None Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Domain-Name: None Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Identity-Status: Confirmed Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Is-Admin-Project: True Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Domain-Id: default Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Domain-Name: Default Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Project-Name: admin Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Role: member,reader,admin Sep 13 19:43:55.790224 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Roles: member,reader,admin Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_af00e3aad1ad462b983823ea889f0033", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/af00e3aad1ad462b983823ea889f0033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/af00e3aad1ad462b983823ea889f0033"}]}] Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant: admin Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant-Id: af00e3aad1ad462b983823ea889f0033 Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-Tenant-Name: admin Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User: admin Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Domain-Id: default Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Domain-Name: Default Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Id: cc92c723f30741629d9940fdc108b101 Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: X-User-Name: admin Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: method: > Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: exception: Flavor 451 could not be found. Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: action_args: {'id': '451'} Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:43:55.792786 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:55.794872 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: ERROR nova.api.openstack.wsgi Sep 13 19:43:55.797009 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-adc4a9c7-b290-4240-b90e-d14942cfb1ba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:43:55.798891 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-adc4a9c7-b290-4240-b90e-d14942cfb1ba admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.014147 Sep 13 19:43:55.798891 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 19:43:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 19:43:57.188377 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:57.189444 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 13 19:43:57.189867 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:43:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:57.857791 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-ca52e9df-2d82-4628-a3b1-de90e042a9e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:57.881808 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-ca52e9df-2d82-4628-a3b1-de90e042a9e4 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.554160 Sep 13 19:43:57.882375 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 19:43:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:43:59.180853 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:43:59.181961 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Sep 13 19:43:59.182381 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:43:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:43:59.765931 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-3fed4339-2c27-4e44-9565-5683eebcd782 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:43:59.798111 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-3fed4339-2c27-4e44-9565-5683eebcd782 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.477501 Sep 13 19:43:59.799170 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 19:43:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:44:01.184557 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:44:01.185760 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001867 Sep 13 19:44:01.186311 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:44:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:44:01.776513 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-2df15c5e-8e80-44dd-8eb4-9d094c6c6a63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:44:01.800742 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-2df15c5e-8e80-44dd-8eb4-9d094c6c6a63 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.477435 Sep 13 19:44:01.801365 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 19:44:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:44:03.139612 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:44:03.141205 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002233 Sep 13 19:44:03.141826 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:44:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:44:04.107232 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-eaaf61e9-bf58-49ac-ba63-8dca53e0886f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:44:04.127663 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-eaaf61e9-bf58-49ac-ba63-8dca53e0886f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.737761 Sep 13 19:44:04.128237 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Sep 13 19:44:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:44:05.400098 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:44:05.401473 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Sep 13 19:44:05.401995 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:44:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:44:06.026657 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-6d1e88d6-465b-41dd-8831-ffa6d1b8160c admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:44:06.049414 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-6d1e88d6-465b-41dd-8831-ffa6d1b8160c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.509084 Sep 13 19:44:06.049952 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Sep 13 19:44:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:45:08.160231 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:45:08.161285 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-76a900ff-4096-420b-8657-180df6c65f01 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 13 19:45:08.161658 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 931 bytes} [Tue Sep 13 19:45:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:45:08.174345 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.648139 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-86d5a9a6-58ad-43b3-9652-9fb19c4541f8 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:45:08.687316 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-86d5a9a6-58ad-43b3-9652-9fb19c4541f8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.514215 Sep 13 19:45:08.688263 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1292 bytes} [Tue Sep 13 19:45:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:45:08.724618 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_api:SELECT=14 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.728678 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-29b38164-9c0f-45a3-8d6f-8f447b83d93a admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:45:08.736938 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-29b38164-9c0f-45a3-8d6f-8f447b83d93a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013643 Sep 13 19:45:08.737513 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Sep 13 19:45:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:45:08.750639 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-f8f7e73b-380d-4689-a1c7-3049c4329899 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:45:08.759043 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-f8f7e73b-380d-4689-a1c7-3049c4329899 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012089 Sep 13 19:45:08.759643 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Sep 13 19:45:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:45:08.775810 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:45:08.789105 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019928 Sep 13 19:45:08.790039 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1286 bytes} [Tue Sep 13 19:45:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:45:08.807424 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-23b0783c-9677-4a60-9de7-674edc81aa9c admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:45:08.815670 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-23b0783c-9677-4a60-9de7-674edc81aa9c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011784 Sep 13 19:45:08.816382 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1283 bytes} [Tue Sep 13 19:45:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:48:10.854821 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:10.856720 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Sep 13 19:48:10.857126 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:48:11.001133 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_api:SELECT=6 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:11.185227 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:11.191383 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:11.191845 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:11.192284 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:11.193019 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:11.193450 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:11.193896 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:11.226157 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-c8702bb4-84b0-42d0-ac95-8a609712d536 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.226198 Sep 13 19:48:11.226745 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 19:48:10 2022] GET /compute/v2.1/os-services => generated 791 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:48:12.330306 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:12.331372 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 13 19:48:12.331780 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:48:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:48:12.520269 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:12.523770 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:12.524248 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:12.524701 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:12.525444 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:12.525886 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:12.526298 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:12.545632 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-8d19aaf0-045a-40f7-b7bd-14ba89c1b0b5 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075977 Sep 13 19:48:12.546201 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 19:48:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:48:24.082260 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:24.083411 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Sep 13 19:48:24.083931 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:48:24.230669 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_cell0:SELECT=4 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:24.231393 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_cell1:SELECT=4 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:24.232144 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG dbcounter [-] [117103] Writing DB stats nova_api:SELECT=8 {{(pid=117103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:24.286690 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:24.291795 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:24.292391 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:24.292799 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:24.293718 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:24.294524 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:24.294963 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:24.320225 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-636ab4eb-5d42-493f-bef7-306bf6a5f12b admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.094503 Sep 13 19:48:24.320784 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 19:48:24 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:48:25.410398 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG nova.api.openstack.wsgi [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] Calling method '>' {{(pid=117104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:25.411419 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: INFO nova.api.openstack.requestlog [None req-71952215-5bfa-4494-a896-0df8caa5c33f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 13 19:48:25.411837 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: [pid: 117104|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Sep 13 19:48:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:48:25.601969 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG nova.api.openstack.wsgi [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] Calling method '>' {{(pid=117103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:48:25.605337 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:25.605812 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:25.606239 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:25.606940 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:48:25.607481 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:48:25.607869 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: DEBUG oslo_concurrency.lockutils [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:48:25.629536 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: INFO nova.api.openstack.requestlog [None req-dc3ca999-4066-4256-a855-3d6cb207da42 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.081851 Sep 13 19:48:25.630019 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: [pid: 117103|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Sep 13 19:48:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:49:22.763113 dv-cinder-828806-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 19:49:22.764033 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: Tue Sep 13 19:49:22 2022 - graceful shutdown triggered... Sep 13 19:49:22.764534 dv-cinder-828806-6-iscsi devstack@n-api.service[117103]: Gracefully killing worker 1 (pid: 117103)... Sep 13 19:49:22.764938 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: Gracefully killing worker 2 (pid: 117104)... Sep 13 19:49:22.897906 dv-cinder-828806-6-iscsi devstack@n-api.service[117104]: DEBUG dbcounter [-] [117104] Writing DB stats nova_api:SELECT=4 {{(pid=117104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:49:23.765017 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: worker 1 buried after 1 seconds Sep 13 19:49:23.765017 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: worker 2 buried after 1 seconds Sep 13 19:49:23.765017 dv-cinder-828806-6-iscsi devstack@n-api.service[117102]: goodbye to uWSGI. Sep 13 19:49:23.766547 dv-cinder-828806-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 19:49:23.767110 dv-cinder-828806-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 19:49:23.770017 dv-cinder-828806-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 19:49:23.779537 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:49:23 2022] *** Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: nodename: dv-cinder-828806-6-iscsi Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: machine: x86_64 Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: clock source: unix Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: pcre jit disabled Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: detected number of CPU cores: 4 Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: current working directory: / Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:49:23.781739 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: your processes number limit is 47680 Sep 13 19:49:23.782538 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: your memory page size is 4096 bytes Sep 13 19:49:23.782538 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: detected max file descriptor number: 2048 Sep 13 19:49:23.782538 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: lock engine: pthread robust mutexes Sep 13 19:49:23.782538 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: thunder lock: enabled Sep 13 19:49:23.782538 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 19:49:23.782538 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:49:23.831119 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: Python main interpreter initialized at 0x5604ff8a59c0 Sep 13 19:49:23.831119 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: python threads support enabled Sep 13 19:49:23.831119 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: your server socket listen backlog is limited to 100 connections Sep 13 19:49:23.831119 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:49:23.831569 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:49:23.831569 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: *** Operational MODE: preforking *** Sep 13 19:49:23.831971 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:49:23.831971 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: spawned uWSGI master process (pid: 132111) Sep 13 19:49:23.832084 dv-cinder-828806-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 19:49:23.835679 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: spawned uWSGI worker 1 (pid: 132127, cores: 1) Sep 13 19:49:23.835679 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: spawned uWSGI worker 2 (pid: 132128, cores: 1) Sep 13 19:49:23.835679 dv-cinder-828806-6-iscsi devstack@n-api.service[132111]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:49:24.510733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:49:24.519752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 19:49:25.698753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:25.698753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: from cryptography.utils import int_from_bytes Sep 13 19:49:25.699679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:25.699679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: from cryptography.utils import int_from_bytes Sep 13 19:49:25.767557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:25.767557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: from cryptography.utils import int_from_bytes Sep 13 19:49:25.768192 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:49:25.768192 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: from cryptography.utils import int_from_bytes Sep 13 19:49:28.141441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:49:28.142134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:49:28.142225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:49:28.142603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:49:28.143331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:49:28.143331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.143524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.143836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.144178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.144470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.144779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.145132 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.145480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.145775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.146056 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.146395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.146902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-6-iscsi {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.147220 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.147506 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.147838 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.148156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.148460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.148776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.149186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.149700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.150158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.150469 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.150752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.151102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.151417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.151726 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.152044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.152353 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.152685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.153025 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.153446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-6-iscsi {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.153764 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.154073 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.154385 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.154814 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.155127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.155464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.155751 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.156075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.156380 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.156746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.157053 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.157375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.157696 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.158004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.158311 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.158618 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.158941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.159233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.159536 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.159785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.160091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.160409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.160725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.161076 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.161327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.161575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.161890 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.162205 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.162510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.162819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.163121 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.163436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.163719 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.164019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.164323 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.164667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.165040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.165339 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.165658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.166002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.166318 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.166733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.167047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.167279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.167640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.167959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.168419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.168597 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.168875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.169195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.169689 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.172964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.173968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.173968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.173968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.173968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.174397 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.174397 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.174634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177693 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177693 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.177886 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.178198 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.178527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.178842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.179143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.179448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.179769 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.180040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.180447 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.180771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.181369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.181510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.181735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.182045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.182371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.182680 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.182961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.183288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.183585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.183883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.184146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.184473 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.184759 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.185072 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.185366 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.185701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.186018 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.186327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.186627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.186931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.187262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.187572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.187910 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.188244 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.188568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.188915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.189287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.189604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.189911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.190247 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.190534 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.190848 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.191156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.191527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.191774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.192171 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.192418 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.192732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.193069 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.193389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.193700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.194016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.194349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.194741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.194983 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.195416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.195754 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.196035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.196362 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.196687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.197036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.197352 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.197662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.198007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.198393 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.198626 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.198941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.199254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.199583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.199893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.200204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.200513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.200823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.201209 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.201500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.201826 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.202139 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.202451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.202761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.203081 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.203392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.203703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.204011 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.204502 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.204854 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.205140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.205565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.205741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.206062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.206391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.206698 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.207033 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.207336 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.207646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.207957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.208323 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.208616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.208862 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.209198 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.209502 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.209817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.210119 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.210430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.210756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.211042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.211347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.211741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.212070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.212360 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.212674 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.213009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.213339 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.213645 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.213954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.214291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.214623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.214929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.215250 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.215656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.215883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.216187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.216491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.216793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.217119 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.217422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.217730 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.218054 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.218408 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.218615 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.218914 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.219214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.219533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.219877 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.220138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.220437 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.220860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.221172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.221427 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.221767 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.222293 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.222453 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.222770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.223039 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.223351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.223663 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.223973 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.224285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.224590 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.224927 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.225240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.225559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.225867 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.226186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.226495 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.226854 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.227234 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.227486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.227824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.228178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.228557 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.228809 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.229144 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.229458 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:49:28.230096 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.230263 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:49:28.230434 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.230434 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.230721 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:49:28.230864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.231105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:49:28.231282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.231562 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:49:28.231722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.231866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.232017 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.232170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.232529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.232529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.232849 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.233124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.233280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.233424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.233576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.233728 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.233878 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.234028 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.234172 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.234314 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.234547 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.234715 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.234866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.235010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.235160 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.235320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.235472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.235622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.235773 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-6-iscsi {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.235974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.236137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.236310 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.236588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.236749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.236972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.237125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.237270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.237420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.237572 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.237722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.237865 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.238013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.238163 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.238313 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.238313 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.238313 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.238313 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.238313 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.239235 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.239404 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.239586 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.239733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.239883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.240026 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.240281 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.240469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.240751 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.240931 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.241125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.241354 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.241522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.241798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.241972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.241972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.242309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.242309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.243025 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.243025 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.243475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.243629 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.243779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.243936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.244090 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-6-iscsi {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.244251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.244414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.244565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.244709 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.244860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.245040 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.245186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.245328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.245470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.245612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.245776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.245919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.246128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.246277 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.246428 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.246590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.246829 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.246985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.247137 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.247280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.247430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.247582 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.247733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.247903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.248056 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.248056 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.248328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.248485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.248637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.248786 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.249098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.249275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.249497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.249663 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.249816 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.249967 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.250130 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.250291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.250524 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.250524 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.250827 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.250971 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.251114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.251267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.251516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.251794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.251943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.252096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.252269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.252434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.252434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.252834 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.253113 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.253282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.253506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.253674 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.253835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.253992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.254145 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.254288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.254450 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.254608 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.254760 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.254902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.255052 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.255204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.255357 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.255500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.255642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.255791 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.255975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.256165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.256371 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.256518 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.256669 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.256839 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.257135 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.257284 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.257427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.257576 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.257753 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.257907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.258065 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.258216 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.258406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.258566 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.258738 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.259102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.259368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.259536 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.259761 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.259909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.260059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.260213 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.260396 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.260571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.260801 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.260980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.261158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.261314 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.261459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.261849 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.262004 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.262147 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.262298 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.262533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.262689 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.262850 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.263102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.263381 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.263561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.263829 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.263979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.264131 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.264297 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.264446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.264599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.264743 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.264938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.265101 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.265253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.265445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.265606 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.265768 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.265917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.265917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.266196 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.266402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.266563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.266716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.266869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.267012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.267277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.267434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.267591 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.267737 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.267898 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.268042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.268197 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.268369 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.268514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.268656 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.268798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.269069 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.269221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.269403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.269674 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.269928 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.270077 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.270077 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.270379 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.270379 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.270671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.270831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.271087 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.271242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.271392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.271535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.271703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.272071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.272240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.272240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.272556 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.272700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.272842 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.273022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.273274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.273558 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.273716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.274037 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.274193 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.274352 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.274496 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.274645 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.274789 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.274951 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.275097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.275249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.275400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.275551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.275702 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.275853 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.276007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.276160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.276320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.276512 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.276676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.276830 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.277013 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.277174 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.277420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.277578 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.277722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.277863 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.278014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.278164 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.278309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.278457 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.278608 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.278865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.279042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.279195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.279340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.279483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.279644 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.280075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.280256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.280424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.280578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.280728 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.280872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.281090 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.281379 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:49:28.281549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.281703 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.281846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.282190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.282357 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.282510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.282661 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.282812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.282962 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.283105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.283278 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.283502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.283762 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.283942 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.284194 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.284397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.284556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.284700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.284851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.285022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.285167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.285312 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.285467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.285467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.285750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.285750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.286042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.286202 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.286353 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.286499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.286696 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.286857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.287001 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.287157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.287309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.287560 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.287712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.287856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.288018 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.288177 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.288355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.288503 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.288646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.288646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.288947 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.289113 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.289266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.289409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.289599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.289759 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.289916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.290292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.290460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.290607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.290750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.290893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.291051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.291195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.291355 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.291606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.291755 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.291899 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.292069 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.292441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.292602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.292748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.292963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.293114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.293271 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.293415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.293665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.293937 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.294097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.294434 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.294596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.294741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.294897 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.295051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.295202 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.295355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.295506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.295649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.295792 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.295933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.296084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.296621 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.296831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.297021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.297175 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.297336 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.297485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.297755 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.297913 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.298070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.298243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.298403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.298563 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.298793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.298968 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.299135 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.299295 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.299454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.299645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.299804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.299971 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.300120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.300539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.300708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.300871 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.301125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.301358 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.301584 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.301856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.302029 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.302190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.302619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.302785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.302943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.303109 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.303283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.303505 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.303809 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.303990 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.304556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.304722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.304902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.305071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.305314 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.305481 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.306219 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.306391 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.306559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.306719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.306893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.307104 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.307264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.307416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.307583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.307969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.308132 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.308324 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.308515 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.308716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.308879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.309070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.309230 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.309388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.309539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.309698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.309849 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.310070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.310227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.310402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.310657 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.310828 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.310987 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.311138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.311448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.311638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.311793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.312066 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.312224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.312405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.312405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.312997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.313206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.313371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.313530 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.313689 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.313948 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.314105 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.314274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.314568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.314820 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.314985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.315136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.315294 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.315459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.315651 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.315808 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.315968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.316119 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.316302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.316467 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.316627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.316796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.317000 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.317215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.317400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.317561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.317722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.317887 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.318143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.318302 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.318467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.318619 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.318785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.318944 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.319103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.319253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.319415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.319582 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.319740 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.319890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.320067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.320241 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.320420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.320571 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.320861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.321078 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.321233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.321399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.321685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.321849 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.322007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.322280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.322468 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.322632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.322948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.323113 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.323273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.323424 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.323581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.323751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.323929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.324165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.324324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.324474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.324821 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.325102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.325279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.325431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.325580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.325730 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.325889 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.326049 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.326208 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.326368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.326527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.326687 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.326849 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.327007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.327185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.327373 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.327529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.327679 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.327842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.328009 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.328256 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.328411 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.328570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.328729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.328968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.328968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.329312 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.329480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.329647 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.329812 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.329971 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.330136 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.330310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.330475 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.330636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.330818 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.331062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.331227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.331386 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.331542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.331722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.331722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.332127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.332306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.332548 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.332712 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.332872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.333246 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.333409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.333561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.333718 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.333869 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.334052 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.334291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.334465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.334465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.334777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.335022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.335278 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.335444 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.335594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.335759 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.335920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.336078 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.336243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.336457 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.336650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.336810 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.337019 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.337182 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.337357 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.337508 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.337672 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.337821 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.337972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.338138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.338388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.338546 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.338717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.338875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339035 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339210 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.339660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.340545 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.340735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.341062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.341378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.341552 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.341712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.341871 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.342144 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.342314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.342473 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.342736 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.342893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.343217 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.343439 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.343606 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.343757 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.343908 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.344064 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.344231 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.344477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.344644 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.344795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.344974 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.345253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.345486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.345486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.345810 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.345964 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.346130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.346298 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.346459 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.346624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.346774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.346939 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.347097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.347248 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.347414 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.347591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.347750 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.347919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.348071 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.348237 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.348413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.348413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.348806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.349006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.349160 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.349330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.349491 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.349660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.349828 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.349994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.350161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.350319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.350496 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.350650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.350809 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.350967 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.351125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.351300 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.351542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.351699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.351850 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.351850 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.352306 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.352485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.352647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.352912 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.353187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.353367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.353535 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.353707 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.353867 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.354016 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.354174 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.354330 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.354588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.354757 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.354916 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.355085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.355261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.355531 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.355768 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.355935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.356103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.356103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.356398 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.356557 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.356733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.356957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.357125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.357283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.357444 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.357602 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.357775 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.357938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.358101 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.358262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.358262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.358574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.358822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.358991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.358991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.359307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.359474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.359640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.359806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.359966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.360133 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.360308 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.360473 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.360631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.360789 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.360990 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.361147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.361319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.361477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.361477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.361875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.362028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.362189 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.362189 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.362598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.362598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.362918 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.363150 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.363460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.363623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.363773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.363940 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.364089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.364256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.364498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.364746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.364923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.365082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.365252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.365412 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.365687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.365944 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.366111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.366264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.366424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.366584 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.366742 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.366894 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.367044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.367194 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.367361 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.367521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.367725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.367887 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.368052 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.368210 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.368376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.368544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.368703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.368984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.369143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.369316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.369469 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.369635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.369793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.369955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.370125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.370292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.370457 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.370618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.370776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.370935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.371093 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.371266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.371426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.371580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.371756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.372002 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.372170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.372340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.372492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.372780 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.372959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.373136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.373527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.373696 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.373855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.374014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.374166 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.374317 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.374476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.374629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.375505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.375685 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.378360 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.378551 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.378710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.378865 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.379158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.379329 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.379483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.379635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.379635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.380083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.380259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.380424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.380575 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.380725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.380875 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.381073 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.381248 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.381400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.381558 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.381718 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.381877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.382150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.382331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.382485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.382643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.382802 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.382968 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.383257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.383736 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.383912 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.384074 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.384226 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.384385 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.384546 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.384715 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.384915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.385176 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.385347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.385499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.385667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.385827 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.385827 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.386301 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.386461 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.386636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.386636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.386932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.387116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.387386 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.387542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.387703 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.387863 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.388030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.388190 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.388342 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.388492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.388653 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.388811 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.389079 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.389357 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.389545 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.389698 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.389863 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.390031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.390190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.390368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.390521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.390688 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.390848 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.391015 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.391166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.391331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.391483 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.391666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.391819 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.391968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.392155 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.392422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.392579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.392739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.392927 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.393086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.393257 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.393572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.394247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.394440 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.394605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.394772 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.394926 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.395075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.395359 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.395521 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.395674 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.395832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.396137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.396328 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.396632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.396798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.397021 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.397178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.397337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.397623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.397791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.397943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.398117 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.398285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.398450 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.398610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.398776 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.398991 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.399172 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.399345 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.399613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.399779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.399933 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.400091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.400257 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.400419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.400578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.400830 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.401024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.401186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.401336 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.401507 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.401659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.401832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.401992 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.402158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.402312 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.402590 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.402767 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.402926 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.403085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.403236 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.403393 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.403574 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.403954 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.403954 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.404524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.404635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.404737 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.404826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.404953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405144 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405228 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405312 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.405914 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406126 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406126 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406375 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406575 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406770 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406843 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.406922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407183 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407370 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407718 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407861 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.407938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408033 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408129 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408393 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408550 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.408981 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409089 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409191 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409278 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409364 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409458 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409787 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409880 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.409965 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410050 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410144 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410226 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410319 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410573 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410671 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410758 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.410851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411194 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411194 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411366 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411546 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411639 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411834 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.411928 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412115 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412211 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412298 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412381 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412649 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.412931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413304 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413570 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413837 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.413929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414074 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414144 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414365 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.414935 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415484 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415615 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.415882 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416121 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416210 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416302 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416560 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416640 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416726 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.416857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417039 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417300 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.417791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418262 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418783 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.418783 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.419892 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420099 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.420300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.422024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.423454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.424790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.426138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.428624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.429991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.431996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.432777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.433460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.433460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.433627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.433841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.434157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.434494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.434812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.435128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.435511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.435857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.436322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.436678 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.437027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.437363 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.437729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.438020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.438329 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.438656 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.438972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.439276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.439600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.439918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.440264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.440575 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.440904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.441242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.441549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.441864 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.442170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.442504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.442815 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.443124 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.443429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.443742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.444055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.444402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.444712 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.445056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.445465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.445727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.446022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.446322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.446637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.446995 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.447311 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.447626 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.447997 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.448315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.448618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.449028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.449381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.449661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.450002 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.450482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.450638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.450951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.451484 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.451823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.452265 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.452542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.452829 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.453169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.453482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.453794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.454118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.454433 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.454750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.455064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.455378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.455698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.456006 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.456303 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.456616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.456946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.457260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.457578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.457890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.458202 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.458516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.458832 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.459178 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.459499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.459709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO dbcounter [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Registered counter for database nova_api Sep 13 19:49:28.459812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.460123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.460444 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.460757 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.461146 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.461442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.461837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.462212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.462542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.462795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.463158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.463545 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.463856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.464176 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.464501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.464812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.465166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.465488 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.465823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.466122 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.466437 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.466765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.467111 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.467443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.467776 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.468085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.468392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.468700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.469043 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.469366 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.469680 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.469986 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.470292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.470602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.470909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.471217 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.471523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.471828 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.472140 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.472446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.472751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.473080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.473387 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.473693 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.473997 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.474307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.474613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.475258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.475258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.475857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.475857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.476464 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.476464 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.476847 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.477460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.477460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.477795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.478107 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.478434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.478802 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.479080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.479390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.479724 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.480037 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.480352 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.480666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.480759 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_db.sqlalchemy.engines [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.481026 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.481439 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.481827 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.482085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.482414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.482723 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.483051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.483371 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.483721 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.484146 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.484318 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.484650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.484990 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.485306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.485618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.485930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.486245 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.486580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.486866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.487177 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.487535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.487841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.488141 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.488318 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writer thread running {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:28.488528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.488776 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.489129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.489460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.489813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.490128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.490493 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.490789 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.491107 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.491421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.491727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:49:28.491986 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:49:28.546010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.context [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50830944-793d-4e46-b527-41f92d9eef04(cell1) {{(pid=132128) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:49:28.550522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:28.550984 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:28.552566 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:28.553330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:28.553774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:28.554398 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO dbcounter [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Registered counter for database nova_api Sep 13 19:49:28.555813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:28.557895 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO dbcounter [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Registered counter for database nova_cell0 Sep 13 19:49:28.562175 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO dbcounter [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Registered counter for database nova_cell1 Sep 13 19:49:28.569460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_db.sqlalchemy.engines [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.571051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_db.sqlalchemy.engines [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.576348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_db.sqlalchemy.engines [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.577932 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writer thread running {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:28.579201 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writer thread running {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:28.583685 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writer thread running {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:28.641241 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.context [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),50830944-793d-4e46-b527-41f92d9eef04(cell1) {{(pid=132127) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 19:49:28.645396 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:28.645869 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:28.647409 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:28.648128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:49:28.648564 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:49:28.650684 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:49:28.652741 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO dbcounter [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Registered counter for database nova_cell0 Sep 13 19:49:28.656955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO dbcounter [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Registered counter for database nova_cell1 Sep 13 19:49:28.664960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_db.sqlalchemy.engines [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.666783 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_db.sqlalchemy.engines [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.672924 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writer thread running {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:28.678742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writer thread running {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:28.726106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO dbcounter [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Registered counter for database nova_cell0 Sep 13 19:49:28.734252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_db.sqlalchemy.engines [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.739817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writer thread running {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:28.822960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO dbcounter [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Registered counter for database nova_cell0 Sep 13 19:49:28.830219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_db.sqlalchemy.engines [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:49:28.838705 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writer thread running {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:49:29.059427 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: WARNING keystonemiddleware.auth_token [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:29.066941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: WARNING keystonemiddleware.auth_token [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:29.161349 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: WARNING keystonemiddleware.auth_token [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:29.168767 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: WARNING keystonemiddleware.auth_token [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:29.420834 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: WARNING keystonemiddleware.auth_token [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:29.427505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: WARNING keystonemiddleware.auth_token [None req-7760555e-c810-406b-af3f-157bc8cc6c06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:29.433127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604ff8a59c0 pid: 132128 (default app) Sep 13 19:49:29.520270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: WARNING keystonemiddleware.auth_token [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 19:49:29.526406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: WARNING keystonemiddleware.auth_token [None req-f00ce322-7791-4441-bb95-46ef4e3c5c6b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 19:49:29.531803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604ff8a59c0 pid: 132127 (default app) Sep 13 19:50:07.018514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:07.020131 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:07.034205 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:07.035667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:08.756091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-601e1c37-5e03-4e23-a54a-1a2a3f583d71 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Action: 'create', calling method: .version_select at 0x7f98b7a60430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-704828896"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:11.782761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-601e1c37-5e03-4e23-a54a-1a2a3f583d71 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.780072 Sep 13 19:50:11.798400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Sep 13 19:50:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4796 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 19:50:11.829027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:11.832340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:11.836209 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:11.838687 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:12.370483 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a0abaa80-899e-4149-9e1e-a78fb3989615 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b7aa3160>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:13.266135 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a0abaa80-899e-4149-9e1e-a78fb3989615 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811" status: 200 len: 345 microversion: 2.1 time: 1.470192 Sep 13 19:50:13.267457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:50:11 2022] GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 => generated 345 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:13.283396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-aecf7758-598f-4abf-9b6c-e683ce069869 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Action: 'create', calling method: .version_select at 0x7f98b7931280>, body: {"snapshot": {"volume_id": "548aa699-b9c4-479e-bee3-2e5b822fa811", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-968036966"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:14.001775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-aecf7758-598f-4abf-9b6c-e683ce069869 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.723153 Sep 13 19:50:14.011121 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 2/3] 10.222.0.18 () {60 vars in 1162 bytes} [Tue Sep 13 19:50:13 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:14.021896 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-26e8be41-f745-4ed6-818e-23b9ae00c755 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b7970310>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:14.189882 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-26e8be41-f745-4ed6-818e-23b9ae00c755 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 286 microversion: 2.1 time: 0.177317 Sep 13 19:50:14.191415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:14 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 286 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:14.215448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-31b2ddd4-7621-4529-8c17-7f73ab27abd6 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b78c6550>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:14.407796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-31b2ddd4-7621-4529-8c17-7f73ab27abd6 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.208684 Sep 13 19:50:14.409742 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Sep 13 19:50:14 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:14.424904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6a9953b5-16d2-4d22-8686-5de3fbdf9f5d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b7970a60>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:14.662525 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6a9953b5-16d2-4d22-8686-5de3fbdf9f5d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 286 microversion: 2.1 time: 0.242407 Sep 13 19:50:14.664352 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:14 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 286 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:14.685443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-735055270", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "networks": [{"uuid": "160c7bf8-886d-4278-bc6b-59f0ad6927c7"}]}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:14.895045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] validate_networks() for [('160c7bf8-886d-4278-bc6b-59f0ad6927c7', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:15.678562 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d17541f1-ef79-4854-8495-4cd4e06f2fd3 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b7970b80>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:15.739779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d17541f1-ef79-4854-8495-4cd4e06f2fd3 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 286 microversion: 2.1 time: 0.066181 Sep 13 19:50:15.741162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:15 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:16.295447 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:50:16.296671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:50:16.297372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:50:16.297967 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:50:16.298543 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:50:16.329616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:16.337822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:16.338514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:16.339818 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:16.340878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:16.341991 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:16.404212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Getting quotas for project d86336ff2858481ea24231bfb10775f1. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:16.414812 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Getting quotas for user f98fd1481406494e995df1128897415f and project d86336ff2858481ea24231bfb10775f1. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:16.448435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:50:16.451908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:50:16.638679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5751f1b7-2bd5-4bb0-9044-201f919eee4b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.088722 Sep 13 19:50:16.640932 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 4/8] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:50:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 19:50:16.660775 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d8fe8425-5089-459e-84ca-f91bed803a86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:16.674993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d8fe8425-5089-459e-84ca-f91bed803a86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:16.754371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-76aecbf0-6013-44b1-bd2d-0566fda972d3 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b6fe04c0>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:16.838608 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-76aecbf0-6013-44b1-bd2d-0566fda972d3 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 286 microversion: 2.1 time: 0.088946 Sep 13 19:50:16.839187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 5/9] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:16 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:17.251061 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d8fe8425-5089-459e-84ca-f91bed803a86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:17.287453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d8fe8425-5089-459e-84ca-f91bed803a86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1214 microversion: 2.1 time: 0.636269 Sep 13 19:50:17.291679 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 5/10] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:16 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1214 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:17.855283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-10b74a8d-36a6-4a0d-85b4-8d47adb8be14 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b6fe0c10>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:17.975595 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-10b74a8d-36a6-4a0d-85b4-8d47adb8be14 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 287 microversion: 2.1 time: 0.126867 Sep 13 19:50:17.976249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 6/11] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:17 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:17.995761 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3b8ea811-183f-4f81-86a5-12e2bc83281d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b7970f70>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:18.205136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3b8ea811-183f-4f81-86a5-12e2bc83281d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 202 len: 0 microversion: 2.1 time: 0.217272 Sep 13 19:50:18.206082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Sep 13 19:50:17 2022] DELETE /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:50:18.217453 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d70ba3d9-3ddd-41e9-9408-ef70cd18f16b tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b6fe0dc0>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:18.293350 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d70ba3d9-3ddd-41e9-9408-ef70cd18f16b tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 286 microversion: 2.1 time: 0.082317 Sep 13 19:50:18.294555 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:18 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:18.319608 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-32f1916a-85d2-408b-8f74-7ba585de024f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:18.320877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-32f1916a-85d2-408b-8f74-7ba585de024f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:18.515482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-32f1916a-85d2-408b-8f74-7ba585de024f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:18.527222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-32f1916a-85d2-408b-8f74-7ba585de024f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1214 microversion: 2.1 time: 0.217686 Sep 13 19:50:18.527929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 7/14] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:18 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1214 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:19.315801 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1215c3ce-a2c1-4ef3-9e7a-52313573530f tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b6fe0550>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:19.361425 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1215c3ce-a2c1-4ef3-9e7a-52313573530f tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 286 microversion: 2.1 time: 0.050017 Sep 13 19:50:19.368665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 8/15] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:19 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:19.571060 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:19.571852 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:19.582488 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:19.585724 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:19.586302 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:19.587724 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:19.591048 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:19.591636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:20.122127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:20.150991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-51c471b6-57f7-45a5-8573-88502496b532 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1218 microversion: 2.1 time: 0.581634 Sep 13 19:50:20.168675 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:19 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1218 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:20.375333 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-eafdbc34-c1ae-4745-ab89-ec533c30797d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b6fc4e50>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:20.433619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-eafdbc34-c1ae-4745-ab89-ec533c30797d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 200 len: 286 microversion: 2.1 time: 0.062345 Sep 13 19:50:20.434850 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 9/17] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:20 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:21.177598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:21.178253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:21.208282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:21.209269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:21.212513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:21.213418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:21.213907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:21.220879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:21.448757 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5c651465-e16f-4650-bad9-912b3a350f70 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b6fe00d0>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:21.512625 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-5c651465-e16f-4650-bad9-912b3a350f70 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] HTTP exception thrown: Snapshot f6cade05-5a0d-48c4-9beb-d7106bf352ab could not be found. Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5c651465-e16f-4650-bad9-912b3a350f70 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Request method failure captured: Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab HTTP/1.1 Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN7uvjnd0PbRrWzvj7adM8D-PICgzBJi5leg8s9LbrEt4zwb3P2US_rY3CXumJGRgxF3PczPZe2-3FUEDJKKDtNoy2HoBnABf9oIKEZBmeabN7jT1p7oxZLq32LRl-nV3rfhu_UaQMvPXlfvBqY0e7A-S47TH-h89_NTyDeDz_EQQX8 Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:50:21.517245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c23109b34b3c4f75ae636ba98d7b8396", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}] Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: abbec9edbc8741dfa4d47f60c64fc0f5 Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Snapshot f6cade05-5a0d-48c4-9beb-d7106bf352ab could not be found. Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'f6cade05-5a0d-48c4-9beb-d7106bf352ab'} Sep 13 19:50:21.519807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f6cade05-5a0d-48c4-9beb-d7106bf352ab could not be found. (HTTP 404) (Request-ID: req-5a60c3ae-8e49-4feb-9d4c-5ffed165e7c5) Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.521186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:21.522496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f6cade05-5a0d-48c4-9beb-d7106bf352ab could not be found. Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 19:50:21.524141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f6cade05-5a0d-48c4-9beb-d7106bf352ab could not be found. Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f6cade05-5a0d-48c4-9beb-d7106bf352ab could not be found. Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5c651465-e16f-4650-bad9-912b3a350f70 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Returning 404 to user: Snapshot f6cade05-5a0d-48c4-9beb-d7106bf352ab could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:21.526110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5c651465-e16f-4650-bad9-912b3a350f70 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab" status: 404 len: 111 microversion: 2.1 time: 0.077360 Sep 13 19:50:21.530036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 10/18] 10.222.0.18 () {58 vars in 1251 bytes} [Tue Sep 13 19:50:21 2022] GET /compute/v2.1/os-snapshots/f6cade05-5a0d-48c4-9beb-d7106bf352ab => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:21.559798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7807a80f-09f5-4fc0-a981-4f95323b7504 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b828b940>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:21.683618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:21.722026 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-07981e65-e5ca-4eef-9e86-02c2232aa524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1210 microversion: 2.1 time: 0.543855 Sep 13 19:50:21.755431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 9/19] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:21 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1210 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:21.815214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7807a80f-09f5-4fc0-a981-4f95323b7504 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811" status: 202 len: 0 microversion: 2.1 time: 0.286003 Sep 13 19:50:21.821027 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 11/20] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 19:50:21 2022] DELETE /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:50:21.833750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3f4d2e5a-5f35-4b14-b707-2a733fce8a9d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b7879550>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:22.205743 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-3f4d2e5a-5f35-4b14-b707-2a733fce8a9d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] HTTP exception thrown: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3f4d2e5a-5f35-4b14-b707-2a733fce8a9d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Request method failure captured: Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 HTTP/1.1 Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN7uvjnd0PbRrWzvj7adM8D-PICgzBJi5leg8s9LbrEt4zwb3P2US_rY3CXumJGRgxF3PczPZe2-3FUEDJKKDtNoy2HoBnABf9oIKEZBmeabN7jT1p7oxZLq32LRl-nV3rfhu_UaQMvPXlfvBqY0e7A-S47TH-h89_NTyDeDz_EQQX8 Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:50:22.212628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c23109b34b3c4f75ae636ba98d7b8396", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}] Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: abbec9edbc8741dfa4d47f60c64fc0f5 Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '548aa699-b9c4-479e-bee3-2e5b822fa811'} Sep 13 19:50:22.213818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. (HTTP 404) (Request-ID: req-8d7845a2-c14d-4040-9752-27725a22c84b) Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.214507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:22.215589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:50:22.216492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.217443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.223823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3f4d2e5a-5f35-4b14-b707-2a733fce8a9d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Returning 404 to user: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:22.225116 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3f4d2e5a-5f35-4b14-b707-2a733fce8a9d tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811" status: 404 len: 109 microversion: 2.1 time: 0.400595 Sep 13 19:50:22.232265 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 10/21] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:50:21 2022] GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 => generated 109 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:22.248554 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6a1c5ed9-2363-4d43-b953-7735d6fc03d5 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b6fe04c0>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:22.367561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-6a1c5ed9-2363-4d43-b953-7735d6fc03d5 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] HTTP exception thrown: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6a1c5ed9-2363-4d43-b953-7735d6fc03d5 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Request method failure captured: Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 HTTP/1.1 Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN7uvjnd0PbRrWzvj7adM8D-PICgzBJi5leg8s9LbrEt4zwb3P2US_rY3CXumJGRgxF3PczPZe2-3FUEDJKKDtNoy2HoBnABf9oIKEZBmeabN7jT1p7oxZLq32LRl-nV3rfhu_UaQMvPXlfvBqY0e7A-S47TH-h89_NTyDeDz_EQQX8 Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:50:22.370249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c23109b34b3c4f75ae636ba98d7b8396", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}] Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: abbec9edbc8741dfa4d47f60c64fc0f5 Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '548aa699-b9c4-479e-bee3-2e5b822fa811'} Sep 13 19:50:22.371493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. (HTTP 404) (Request-ID: req-f5ec4a4f-cc08-46a3-9b3f-a84704a8f70f) Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.372111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 19:50:22.373088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 19:50:22.373959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.378911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.382057 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6a1c5ed9-2363-4d43-b953-7735d6fc03d5 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Returning 404 to user: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:22.383667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6a1c5ed9-2363-4d43-b953-7735d6fc03d5 tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811" status: 404 len: 109 microversion: 2.1 time: 0.139954 Sep 13 19:50:22.384978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 12/22] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 19:50:22 2022] DELETE /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:22.398714 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4d5c5855-2ec7-4d0e-b80d-6a8c4f3e7feb tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Calling method '.version_select at 0x7f98b828aaf0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:22.457887 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-4d5c5855-2ec7-4d0e-b80d-6a8c4f3e7feb tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] HTTP exception thrown: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4d5c5855-2ec7-4d0e-b80d-6a8c4f3e7feb tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Request method failure captured: Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 HTTP/1.1 Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN7uvjnd0PbRrWzvj7adM8D-PICgzBJi5leg8s9LbrEt4zwb3P2US_rY3CXumJGRgxF3PczPZe2-3FUEDJKKDtNoy2HoBnABf9oIKEZBmeabN7jT1p7oxZLq32LRl-nV3rfhu_UaQMvPXlfvBqY0e7A-S47TH-h89_NTyDeDz_EQQX8 Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:50:22.461332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_c23109b34b3c4f75ae636ba98d7b8396", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/c23109b34b3c4f75ae636ba98d7b8396"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/c23109b34b3c4f75ae636ba98d7b8396"}]}] Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: c23109b34b3c4f75ae636ba98d7b8396 Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1107069395 Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: abbec9edbc8741dfa4d47f60c64fc0f5 Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1107069395-project Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '548aa699-b9c4-479e-bee3-2e5b822fa811'} Sep 13 19:50:22.462517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. (HTTP 404) (Request-ID: req-151f3b8d-5f79-4ae9-98c5-c9cf569b5b97) Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.463147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:50:22.464034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:50:22.465108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. Sep 13 19:50:22.466007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:50:22.471163 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4d5c5855-2ec7-4d0e-b80d-6a8c4f3e7feb tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] Returning 404 to user: Volume 548aa699-b9c4-479e-bee3-2e5b822fa811 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:50:22.472305 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4d5c5855-2ec7-4d0e-b80d-6a8c4f3e7feb tempest-VolumesSnapshotsTestJSON-1107069395 tempest-VolumesSnapshotsTestJSON-1107069395-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811" status: 404 len: 109 microversion: 2.1 time: 0.083219 Sep 13 19:50:22.473649 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 11/23] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:50:22 2022] GET /compute/v2.1/os-volumes/548aa699-b9c4-479e-bee3-2e5b822fa811 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:50:22.778522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:22.779297 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:22.842551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:22.848237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:22.857961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:22.859143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:22.868003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:22.868699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:23.529640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:23.617018 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dd388a2d-8558-45f8-8cf2-a4d0f5ee6d4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1272 microversion: 2.1 time: 0.828526 Sep 13 19:50:23.622679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 13/24] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:22 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1272 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:24.216880 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1bd3f674-ca40-4cc4-a754-03cb6f52355f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'create', calling method: .version_select at 0x7f98b78795e0>, body: {"keypair": {"name": "tempest-keypair-1473984862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeZSwxGWqpJQ3DZNWCnw1C4tMaa7j3V3uQBWDX/z1W/ucFVBAnmQHV4GfL8TITMfGEYOGOML4w5IZptpKdmHQLCIQ/tX9jb/bVYokwU+1F659sdwfsKPX5DZ4j8qt8H/A=="}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:24.386932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-1bd3f674-ca40-4cc4-a754-03cb6f52355f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:24.409940 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-1bd3f674-ca40-4cc4-a754-03cb6f52355f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for user dbea9a6a35c6445a9ab76ee7278abda4 and project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:24.559590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1bd3f674-ca40-4cc4-a754-03cb6f52355f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.183627 Sep 13 19:50:24.561679 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 12/25] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Sep 13 19:50:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 19:50:24.646115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:24.646742 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:24.664706 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:24.672402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:24.672997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:24.675156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:24.675643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:24.678981 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:25.060122 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:25.098595 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3ac32e44-b306-444c-94b9-568f774abe6e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1272 microversion: 2.1 time: 0.455383 Sep 13 19:50:25.101629 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 14/26] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:24 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1272 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:26.142083 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:26.142830 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:26.172333 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:26.174623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:26.176242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:26.179296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:26.179774 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:26.182539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:28.056260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:28.097223 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2ea7f831-20a8-417c-9f12-fce5e5302e5f tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 1.967694 Sep 13 19:50:28.114617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 13/27] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:26 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 1988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:29.141583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:29.142219 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:29.145123 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:29.145837 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:29.171546 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:29.172100 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:29.177921 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:29.178703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:29.179227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:29.179662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:30.375875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:30.391486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c5ee4bb1-fb88-4c11-80d6-50b64753cee3 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 1.253437 Sep 13 19:50:30.406154 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 15/28] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:29 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:31.415222 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:31.417534 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:31.437505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:31.439994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:31.440665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:31.443406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:31.447594 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:31.464736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:32.009762 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d93ca504-f7f1-48f7-ad7c-f027c41b8f13 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'create', calling method: .version_select at 0x7f98b7736670>, body: {"keypair": {"name": "tempest-keypair-374542527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9qSZQ+RpW/jRQ+8E7XhBji/JPK5/3jRXL0fIGLk/5j2nN93+o8TZa+QfeNi4umaGnvKNpdBEsrKC+IzZRH6Zo4skM+rVpQeQkD0QSZH8QmRSz/qjikkg5KaVr8ytlmow=="}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:32.097543 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-d93ca504-f7f1-48f7-ad7c-f027c41b8f13 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:32.105480 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-d93ca504-f7f1-48f7-ad7c-f027c41b8f13 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for user e60df169b5dc4aa59b5b0246544ef2b6 and project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:32.148043 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:32.156720 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a3268ba4-7339-4080-b5ab-cea02704d524 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.745681 Sep 13 19:50:32.169067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 16/29] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:31 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:32.261702 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d93ca504-f7f1-48f7-ad7c-f027c41b8f13 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.451830 Sep 13 19:50:32.271172 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 14/30] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:50:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:50:33.203667 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:33.204517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:33.237280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:33.238121 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:33.238725 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:33.239629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:33.241574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:33.245628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:34.103842 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:34.113666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-aba52a76-0255-43b2-adfb-3e531e63b22d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.913912 Sep 13 19:50:34.124070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 15/31] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:33 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:34.130154 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1601552476", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "812691de-b220-4f78-84eb-5c9190d77034"}], "security_groups": [{"name": "tempest-securitygroup--1711119567"}], "key_name": "tempest-keypair-1473984862", "user_data": "}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:34.275348 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1915119759", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:34.462555 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] validate_networks() for [('5ad795ab-6f5d-44be-b923-ac7221123b91', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:34.931905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] validate_networks() for [('812691de-b220-4f78-84eb-5c9190d77034', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:38.085439 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:50:38.086833 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:50:38.088225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:50:38.088920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:50:38.089513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:50:38.105785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:38.130867 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:38.134878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:38.135559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:38.139465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:38.140124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:38.143235 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:38.178907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=27 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:38.250431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:38.277066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for user a1c9d4af0a98406692e1d79293844c68 and project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:38.372770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:50:38.384198 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:50:38.575332 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-82f61664-b04c-42dc-b5a9-767d31e445e3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.382227 Sep 13 19:50:38.576008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 17/32] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:50:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 5384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:50:39.138067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-9c053aeb-5875-42f5-b8a7-21c40075fd5b req-e86b87b9-7293-4a1e-832d-4eeee2b4b3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c5e80d-5dfc-433b-b9ac-1746a345e69a", "tag": "db780c10-2ead-4956-b95e-59d864a4cb81"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:39.192926 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-9c053aeb-5875-42f5-b8a7-21c40075fd5b req-e86b87b9-7293-4a1e-832d-4eeee2b4b3ff service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.195926 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-9c053aeb-5875-42f5-b8a7-21c40075fd5b req-e86b87b9-7293-4a1e-832d-4eeee2b4b3ff service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.202607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-9c053aeb-5875-42f5-b8a7-21c40075fd5b req-e86b87b9-7293-4a1e-832d-4eeee2b4b3ff service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.247720 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-9c053aeb-5875-42f5-b8a7-21c40075fd5b req-e86b87b9-7293-4a1e-832d-4eeee2b4b3ff service nova] Creating event network-changed:db780c10-2ead-4956-b95e-59d864a4cb81 for instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a on hv-cinder-82880 Sep 13 19:50:39.248930 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-9c053aeb-5875-42f5-b8a7-21c40075fd5b req-e86b87b9-7293-4a1e-832d-4eeee2b4b3ff service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 19:50:39.249674 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-9c053aeb-5875-42f5-b8a7-21c40075fd5b req-e86b87b9-7293-4a1e-832d-4eeee2b4b3ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=132128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 19:50:39.251372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.252226 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.253370 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.254436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.255112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.255767 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.267587 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.compute.rpcapi [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 19:50:39.268999 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] Releasing lock "compute-rpcapi-router" {{(pid=132128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 19:50:39.293641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-07727949-4265-4f36-bd72-364e9ac5cc82 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.698669 Sep 13 19:50:39.305551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 18/33] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:39.319776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:39.328235 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:39.368677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.369795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.371218 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:39.374684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:39.375468 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:39.377120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.574999 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:40.592315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ff8e1ff3-08db-4750-8506-e21ff18d8b67 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 1.282489 Sep 13 19:50:40.595382 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 19/34] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:39 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:40.608509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e0a4ff57-bcca-4785-8157-a74bd584c363 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:40.610787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e0a4ff57-bcca-4785-8157-a74bd584c363 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:40.627871 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:50:40.628673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:50:40.629922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:50:40.630724 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:50:40.631403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:50:40.689777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.694315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.695049 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.696449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:40.697584 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:40.698735 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:40.777909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:40.794687 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for user dbea9a6a35c6445a9ab76ee7278abda4 and project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:40.840717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:50:40.851657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:50:40.985671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e0a4ff57-bcca-4785-8157-a74bd584c363 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:41.028922 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e0a4ff57-bcca-4785-8157-a74bd584c363 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1222 microversion: 2.1 time: 0.427255 Sep 13 19:50:41.029992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 20/35] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:40 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1222 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:41.067306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6353779a-d07d-4c7c-ae8d-bf5e97eb4657 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.942076 Sep 13 19:50:41.073642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 16/36] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Sep 13 19:50:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 6947 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 19:50:41.098577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a3262e8e-e5cf-43c5-81a1-beb177c49d4d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:41.099493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a3262e8e-e5cf-43c5-81a1-beb177c49d4d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:41.282455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a3262e8e-e5cf-43c5-81a1-beb177c49d4d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:41.296020 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a3262e8e-e5cf-43c5-81a1-beb177c49d4d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:41.310359 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a3262e8e-e5cf-43c5-81a1-beb177c49d4d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:41.311599 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a3262e8e-e5cf-43c5-81a1-beb177c49d4d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1282 microversion: 2.20 time: 0.228134 Sep 13 19:50:41.312194 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 21/37] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:41 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1282 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:41.352321 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1191304569", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:41.583449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] validate_networks() for [('5ad795ab-6f5d-44be-b923-ac7221123b91', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:41.624587 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:41.625722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:41.652790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:41.653716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:41.656797 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:41.657948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:41.663415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:41.664343 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:42.031778 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:42.051144 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4a24be03-6548-48a2-af52-cc22d813884e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.433311 Sep 13 19:50:42.060950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 22/38] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:41 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:42.069994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-160437665", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ab97bd9-58ce-4549-8897-4ab0eb987fb8"}], "security_groups": [{"name": "tempest-securitygroup--2113611284"}], "key_name": "tempest-keypair-374542527", "user_data": "}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:42.407173 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] validate_networks() for [('0ab97bd9-58ce-4549-8897-4ab0eb987fb8', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:50:43.003257 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:50:43.004123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:50:43.004993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:50:43.008052 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:50:43.008999 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:50:43.057688 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=5 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:43.078385 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=19 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:43.103672 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.105074 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.105861 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.107179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.110325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.111445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.147882 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=27 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:43.171105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:43.197954 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for user a1c9d4af0a98406692e1d79293844c68 and project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:43.257169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:50:43.274614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:50:43.463018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3d5df548-17e5-4e16-b0a2-dfd08683437b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.126955 Sep 13 19:50:43.465156 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 17/39] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:50:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:50:43.469505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:50:43.470775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:50:43.475819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:50:43.476259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:50:43.476687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:50:43.478092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:43.478709 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:43.496386 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.497521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.498017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.498445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.500213 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.501131 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.506129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.506617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.507053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.509907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.510454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.512914 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.544234 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:50:43.551449 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for user e60df169b5dc4aa59b5b0246544ef2b6 and project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:50:43.569289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:50:43.574375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:50:43.676993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:43.704712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-045ee506-2904-4695-a79e-2f0399d0b509 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.647783 Sep 13 19:50:43.716384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 23/40] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:50:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:50:43.719424 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:43.727581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:43.728985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-648d86ce-baec-4975-a047-7aebfceb365a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1286 microversion: 2.20 time: 0.262138 Sep 13 19:50:43.736636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 18/41] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:43 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:43.759703 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0a7b75a2-d62f-4140-8af2-79478a3e8ade tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:43.762024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0a7b75a2-d62f-4140-8af2-79478a3e8ade tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:43.764169 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:43.764794 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:43.780407 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.780917 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.782146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.783058 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:43.784069 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:43.784796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:43.926954 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0a7b75a2-d62f-4140-8af2-79478a3e8ade tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:43.943031 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0a7b75a2-d62f-4140-8af2-79478a3e8ade tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1222 microversion: 2.1 time: 0.202233 Sep 13 19:50:43.961586 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 19/42] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:43 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1222 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:43.974293 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b64760d6-6913-4b2d-b01d-252e7a0d9e52 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:43.974971 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b64760d6-6913-4b2d-b01d-252e7a0d9e52 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:44.660157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b64760d6-6913-4b2d-b01d-252e7a0d9e52 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:44.676854 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b64760d6-6913-4b2d-b01d-252e7a0d9e52 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1236 microversion: 2.1 time: 0.713580 Sep 13 19:50:44.681646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 20/43] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:43 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1236 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:44.764190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:44.764938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:44.777232 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:44.781482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:44.782182 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:44.783884 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:44.785574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:44.792011 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:44.800742 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d6326ac9-4116-4116-b2df-d7306f80f9e1 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 1.083069 Sep 13 19:50:44.805350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:44.811548 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 24/44] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:43 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:44.903014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:44.911758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:44.913230 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:44.914384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-04f1bf7b-19a9-493a-a9f9-d370b31fdb5b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1286 microversion: 2.20 time: 0.154502 Sep 13 19:50:44.915003 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 21/45] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:44 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:50:44.970909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:44.972324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:44.979634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:44.981193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:44.981905 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:44.982907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:44.983596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:44.984239 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.064517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:45.077282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d1b18fc2-42ea-4746-bc73-70d0702309f6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1226 microversion: 2.1 time: 0.111711 Sep 13 19:50:45.078605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 25/46] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:44 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:45.716338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:45.718147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:45.744078 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.745445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.746236 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.750977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.752129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.753592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.841615 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:45.843178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:45.857946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:45.869978 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9058c5e6-742c-4fa8-94b6-c4cc3c26b77c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1240 microversion: 2.1 time: 0.169747 Sep 13 19:50:45.871015 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 22/47] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:45 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1240 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:45.879883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.881308 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.882263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.883651 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.884462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.885421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.948106 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:45.949211 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:45.958106 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.959314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.959984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:45.961127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:45.961817 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:45.962196 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.076209 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:46.115523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:46.123058 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:46.125473 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-94f86ce0-a477-4f38-be3b-7cc682861c44 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1286 microversion: 2.20 time: 0.182667 Sep 13 19:50:46.126814 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 23/48] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:45 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1286 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:46.136579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:46.138161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:46.150805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.151700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.152680 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.153994 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.154977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.155607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.179485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:46.209371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-92018e1d-b4ae-4dad-af93-abc7b62bc1b0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.373750 Sep 13 19:50:46.216869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 26/49] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:45 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:46.313497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:46.330674 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dd60e467-cc1a-44f1-b354-e60c1dbe9fa3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1226 microversion: 2.1 time: 0.201132 Sep 13 19:50:46.333276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 24/50] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:46 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1226 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:46.899674 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:46.900421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:46.906948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.907422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.907994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.908697 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:46.909688 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:46.910284 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:46.994476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:47.004286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c7b08187-4100-4679-84f7-2ecc05e586d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1240 microversion: 2.1 time: 0.113403 Sep 13 19:50:47.004878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 27/51] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:46 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1240 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:47.151415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:47.151856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:47.159136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.159629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.160259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.161157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.161749 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.162310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.248195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:47.249262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:47.260668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.261563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.262341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.263532 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.264261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.265062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.287597 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:47.298421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:47.299997 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:47.301195 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c827e608-91fb-49fe-a757-7e4d56760c53 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1286 microversion: 2.20 time: 0.153960 Sep 13 19:50:47.301760 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 25/52] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:47 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:47.357950 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:47.358886 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:47.366559 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.367387 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.368037 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.368938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:47.369549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:47.369966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:47.498277 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:47.508436 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-470a6239-a5d5-43ad-90e6-45c23d47c83e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1226 microversion: 2.1 time: 0.153868 Sep 13 19:50:47.509966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 26/53] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:47 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:47.533229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:47.544754 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ff388456-b163-42d5-8e12-c0d8be101c45 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.303688 Sep 13 19:50:47.545460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:47 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:48.038827 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:48.039462 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:48.055666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.056749 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.060563 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.061555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.062503 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.063437 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.153631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.167948 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1052169e-2cf8-45fd-bc98-efd70788e744 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1240 microversion: 2.1 time: 0.140356 Sep 13 19:50:48.168928 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 27/55] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1240 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:48.351435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:48.356042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:48.381315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.382526 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.383424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.389711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.390575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.391356 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.516033 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.526227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.527928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.529405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-65554eaf-ca62-47c1-8cbc-cf3d254e3e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1286 microversion: 2.20 time: 0.185976 Sep 13 19:50:48.530423 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 29/56] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:48.545316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:48.546917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:48.567745 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.568670 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.569819 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.571122 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.572064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.572201 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:48.572955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.573368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:48.585950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.586777 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.587497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.589188 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:48.590156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:48.590877 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:48.726297 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.734520 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-837a0e1c-ac8f-422b-9808-eb5bf9b40a9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1226 microversion: 2.1 time: 0.202018 Sep 13 19:50:48.749358 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 28/57] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1226 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:48.841016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:48.855276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ba57eabe-df11-4d2c-98ce-c4c3cc01a66a tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.291209 Sep 13 19:50:48.855861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 30/58] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:48 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:50:49.198644 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.200025 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:49.219748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.219748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.219748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.219748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.220234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.220234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.328022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:49.341561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0be5a99b-df57-41d3-a1d6-c1cb9336bc5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1240 microversion: 2.1 time: 0.148132 Sep 13 19:50:49.342436 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:49 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1240 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:49.574893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.577966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:49.635607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.636445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.637199 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.664192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.665338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.666717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.766557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.769296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:49.792673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.793505 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.798916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.802519 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.806317 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.808861 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.888285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:49.912935 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:49.921237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:49.924748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-bc49e4c7-eb80-49b8-82ad-d22159117952 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1278 microversion: 2.20 time: 0.360448 Sep 13 19:50:49.926940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 31/60] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:49 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1278 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:49.932257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:49.946015 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:49.963334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.971163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.972390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:49.973417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:49.974184 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:49.977254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:50.010791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:50.021803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-90bf01c9-3aaf-4a34-b305-9324450cfdba tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1218 microversion: 2.1 time: 0.266264 Sep 13 19:50:50.022385 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 30/61] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:49 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:50.357405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:50.368396 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:50.369382 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:50.369750 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-72aaf7de-fe0e-4a37-8453-819d4c035e2e tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.441134 Sep 13 19:50:50.385263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 32/62] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:49 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:50.385696 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:50.385696 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:50.385696 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:50.385696 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:50.385967 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:50.385967 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:50.484338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:50.499036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ada3d82e-65e7-4562-8f3d-39f566df4840 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1232 microversion: 2.1 time: 0.135936 Sep 13 19:50:50.500602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 31/63] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:50 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1232 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:50.987479 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:50.988468 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:51.018498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.019064 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.019505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.020369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.021110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.021756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.057410 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:51.063609 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:51.085976 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.088739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.090994 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.094776 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.099388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.104175 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.359779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:51.369066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:51.384363 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:51.385282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2d662f0f-5613-411b-ab0b-a5b7b1044829 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1218 microversion: 2.1 time: 0.338825 Sep 13 19:50:51.385979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 32/64] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:51 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1218 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:51.393514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:51.395643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3d1558a9-0342-4498-8069-86b5df0209e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1334 microversion: 2.20 time: 0.420888 Sep 13 19:50:51.409963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:51.413708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:51.414265 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 33/65] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:50 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1334 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:51.436820 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.437722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.441259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.442322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.444382 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.445754 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.531749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:51.532365 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:51.541800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.542309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.542744 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.543519 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:51.544199 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:51.544787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:51.962588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:51.994499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:52.014261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-acfaf2c2-581c-40c2-8c8b-c55794085ecb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1288 microversion: 2.1 time: 0.487058 Sep 13 19:50:52.020323 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 34/66] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:51 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1288 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:52.038865 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4a716d61-5132-40e7-90c7-e73e5edaef68 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.638201 Sep 13 19:50:52.054836 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 33/67] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:51 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:52.439932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:52.441108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:52.443622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:52.447221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:52.478708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.483083 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.483378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.486864 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.490612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:52.491951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:52.493782 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.495327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.496969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:52.498527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:52.498720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:52.499740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.054437 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:53.073648 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:53.078179 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:53.080978 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:53.087739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e6ea7c2a-8886-4472-b7c1-fb04bad45b1a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1340 microversion: 2.20 time: 0.656516 Sep 13 19:50:53.092701 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:52 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1340 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:53.108977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:53.111963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:53.131800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-45eb75ed-1b55-4d48-804a-fc970079eb71 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1218 microversion: 2.1 time: 0.697271 Sep 13 19:50:53.138325 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 35/69] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:52 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1218 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:53.139262 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.140474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.142279 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.143535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.144525 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:53.148750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.154780 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.157331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:53.157667 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=4 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.177935 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.178931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.184540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.185738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:53.186412 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:53.187338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:53.532642 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.563609 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=16 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:53.813628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:53.859097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0af14bcd-c283-4c55-afd5-a5c579bff737 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1294 microversion: 2.1 time: 0.759907 Sep 13 19:50:53.859097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 35/70] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:53 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1294 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:54.147698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:54.147963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:54.171087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.172739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.179623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.182299 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.183891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.184364 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.242067 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=100 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.573990 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:54.593270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b0003e98-79f0-4617-9272-69cfe15785dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 1.451073 Sep 13 19:50:54.596156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 36/71] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:53 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:54.606288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:54.607535 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:54.625558 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.626632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.627499 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.628622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.631086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.631980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.661986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.666068 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=9 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:50:54.869809 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:54.890636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2f4aa8ed-2993-4d04-a0d5-fafc6e2edc25 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1280 microversion: 2.1 time: 0.289862 Sep 13 19:50:54.901104 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 37/72] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:54 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1280 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:54.925748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:54.935634 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:54.938733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:54.942267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-48e32cb9-56dc-43b9-9c6f-ff69da350b93 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.800560 Sep 13 19:50:54.943235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 36/73] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:54 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:50:54.948258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:54.949285 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:54.957137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.958162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.958809 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:54.959716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:54.960365 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:54.961022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.048739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-5ed93f43-81f2-43eb-9adb-e10417aa0653 req-7f915df9-f518-4986-96ae-5a1541c7df63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c5e80d-5dfc-433b-b9ac-1746a345e69a", "name": "network-vif-plugged", "status": "completed", "tag": "db780c10-2ead-4956-b95e-59d864a4cb81"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:55.064410 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-5ed93f43-81f2-43eb-9adb-e10417aa0653 req-7f915df9-f518-4986-96ae-5a1541c7df63 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.065438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-5ed93f43-81f2-43eb-9adb-e10417aa0653 req-7f915df9-f518-4986-96ae-5a1541c7df63 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.066614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-5ed93f43-81f2-43eb-9adb-e10417aa0653 req-7f915df9-f518-4986-96ae-5a1541c7df63 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.094948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-5ed93f43-81f2-43eb-9adb-e10417aa0653 req-7f915df9-f518-4986-96ae-5a1541c7df63 service nova] Creating event network-vif-plugged:db780c10-2ead-4956-b95e-59d864a4cb81 for instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a on hv-cinder-82880 Sep 13 19:50:55.104699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-5ed93f43-81f2-43eb-9adb-e10417aa0653 req-7f915df9-f518-4986-96ae-5a1541c7df63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207868 Sep 13 19:50:55.109541 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 38/74] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:55.178397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:55.221622 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-105e3a15-d582-4b90-9360-1b63e204f432 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1294 microversion: 2.1 time: 0.264795 Sep 13 19:50:55.234182 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 37/75] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:54 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1294 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:55.624934 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:55.626865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:55.649019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.652418 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.653975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.656814 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.659604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.661475 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.939968 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:55.941263 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:55.961602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.964684 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.966027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:55.970306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:55.971934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:55.981427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.148865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.157040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2cf0b2e5-0b5a-4bbe-a2ab-2a56445fed4c tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 0.537328 Sep 13 19:50:56.163075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 39/76] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:55 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:56.173829 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:56.174748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.190559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.191424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.192007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.192909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.193506 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.194069 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.199576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.211722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-54e19d82-f29e-498d-a6c6-acd6d21cab66 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1280 microversion: 2.1 time: 0.290880 Sep 13 19:50:56.218630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 38/77] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:55 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1280 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:56.255203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:56.263867 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:56.287980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.288373 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.288805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.289676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.290779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.291376 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.661552 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.686522 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6145dfba-ea52-4856-a70c-449d1e52fd2a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1294 microversion: 2.1 time: 0.438908 Sep 13 19:50:56.688074 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 39/78] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:56 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1294 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:56.716783 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-01a5a662-c8b5-4370-ab53-aca17d846214 req-354dad00-3109-4643-83cb-d852feb760ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4427ca0-6d69-4863-9b14-6b456b1bde67", "tag": "d70eb4a9-b50b-433e-bbff-a0640870c674"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:56.737472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-01a5a662-c8b5-4370-ab53-aca17d846214 req-354dad00-3109-4643-83cb-d852feb760ef service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.738460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-01a5a662-c8b5-4370-ab53-aca17d846214 req-354dad00-3109-4643-83cb-d852feb760ef service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.739840 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-01a5a662-c8b5-4370-ab53-aca17d846214 req-354dad00-3109-4643-83cb-d852feb760ef service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.789328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-01a5a662-c8b5-4370-ab53-aca17d846214 req-354dad00-3109-4643-83cb-d852feb760ef service nova] Creating event network-changed:d70eb4a9-b50b-433e-bbff-a0640870c674 for instance f4427ca0-6d69-4863-9b14-6b456b1bde67 on hv-cinder-82880 Sep 13 19:50:56.790895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-01a5a662-c8b5-4370-ab53-aca17d846214 req-354dad00-3109-4643-83cb-d852feb760ef service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 19:50:56.791858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-01a5a662-c8b5-4370-ab53-aca17d846214 req-354dad00-3109-4643-83cb-d852feb760ef service nova] Acquired lock "compute-rpcapi-router" {{(pid=132127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 19:50:56.794736 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.796358 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.797699 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.800402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:56.802292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:56.804878 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:56.828532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.compute.rpcapi [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 19:50:56.830719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] Releasing lock "compute-rpcapi-router" {{(pid=132127) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 19:50:56.890328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-33f3fb4a-d52e-472b-ba30-75b4ec943245 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187038 Sep 13 19:50:56.895652 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 40/79] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:56.929513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.939448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.947269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:56.948739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-cb39602b-b17c-4ccb-b47d-66801d826b0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.784284 Sep 13 19:50:56.950763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 40/80] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:56 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:57.191090 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:57.192105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:57.205658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.209938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.211168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.212976 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.215310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.219110 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.241666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:57.242446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:57.258290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.261903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.262680 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:57.265569 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:57.267023 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:57.268732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.246093 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.271618 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2086789f-2f61-4515-bc02-0cbb4bf399ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 1.032517 Sep 13 19:50:58.275840 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 41/81] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:57 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:58.307642 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:58.313998 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:58.332612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.333386 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.333826 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.334682 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.334896 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.335340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.417123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:58.428030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f543c66c-8255-4949-920d-809522f74436 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1314 microversion: 2.1 time: 1.244707 Sep 13 19:50:58.429381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 41/82] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:57 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:58.434929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:58.436128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:58.459826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.459826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.459826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:58.459826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:58.461383 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:58.464561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.088290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:59.101318 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3f334590-b441-46ee-97de-e74dd85e73cb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.815089 Sep 13 19:50:59.103544 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 42/83] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:58 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:50:59.115657 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-1b3fc0ac-43cf-4ba5-bbef-0852a2e375eb req-526882ec-ddb0-4351-b6d1-6a26c451b524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc2f361-c297-4a69-9898-d4d3cc310118", "tag": "8c0ed42f-e532-4877-8eca-a8af525da34e"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:50:59.134370 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1b3fc0ac-43cf-4ba5-bbef-0852a2e375eb req-526882ec-ddb0-4351-b6d1-6a26c451b524 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.135234 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1b3fc0ac-43cf-4ba5-bbef-0852a2e375eb req-526882ec-ddb0-4351-b6d1-6a26c451b524 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.138106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1b3fc0ac-43cf-4ba5-bbef-0852a2e375eb req-526882ec-ddb0-4351-b6d1-6a26c451b524 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.171234 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-1b3fc0ac-43cf-4ba5-bbef-0852a2e375eb req-526882ec-ddb0-4351-b6d1-6a26c451b524 service nova] Creating event network-changed:8c0ed42f-e532-4877-8eca-a8af525da34e for instance 9fc2f361-c297-4a69-9898-d4d3cc310118 on hv-cinder-82880 Sep 13 19:50:59.189882 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-1b3fc0ac-43cf-4ba5-bbef-0852a2e375eb req-526882ec-ddb0-4351-b6d1-6a26c451b524 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084856 Sep 13 19:50:59.196393 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 43/84] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:50:59.229198 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:59.273268 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:59.279352 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:59.283996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a44eb0c6-d98f-4ff1-9105-794d14d19b4b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.852893 Sep 13 19:50:59.288754 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 42/85] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:50:58 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:50:59.314979 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:59.328583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:59.359332 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.365891 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.366647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.367879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.368538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.370398 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.456121 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:50:59.457534 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:50:59.474089 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.475255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.477886 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.479092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:50:59.480798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:50:59.482791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:50:59.918944 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:50:59.926989 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8ac2233f-aa62-47b6-932a-463185ffaf9f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.622222 Sep 13 19:50:59.927587 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 44/86] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:59 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:00.071678 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.082903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-41141d79-62e0-4394-9bad-e994572c8a04 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1501 microversion: 2.1 time: 0.632032 Sep 13 19:51:00.083657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 43/87] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:50:59 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1501 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:00.135015 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:00.136306 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:00.148430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.150449 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.151105 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.154131 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.154805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.157486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.318085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:00.318964 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:00.326897 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.327538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.328067 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.328918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.329487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.330059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.776472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.787598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dbee7d8b-86d3-400d-a5a4-25a3f842c9e8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.656989 Sep 13 19:51:00.788230 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 45/88] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:00 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:00.898134 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.911214 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.912666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:00.930170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-77cca2cf-5ff4-414e-9707-7cbe4e1ba5a1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.602670 Sep 13 19:51:00.930953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 44/89] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:00 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:00.955787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:00.956546 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:00.976718 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.982071 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.988539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:00.996326 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:00.998509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:00.999575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.623279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:01.634445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-38981b81-2df0-4962-a5c7-6d2a0cad492a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.684108 Sep 13 19:51:01.635063 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 46/90] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:00 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:01.814203 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:01.815797 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:01.822894 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.823704 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.824405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.825283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.825643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.826383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.865599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-17beacfe-564f-4156-bdd0-f61f9d46ce06 req-9e11abea-3121-4ce2-94f6-03324ad7a53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f7001c0-8809-4b82-b3f6-354d11c02d14", "tag": "7bf5ff37-42b2-43c4-9059-f47c6c9c6cbe"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:01.914526 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-17beacfe-564f-4156-bdd0-f61f9d46ce06 req-9e11abea-3121-4ce2-94f6-03324ad7a53b service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.915883 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-17beacfe-564f-4156-bdd0-f61f9d46ce06 req-9e11abea-3121-4ce2-94f6-03324ad7a53b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.916691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-17beacfe-564f-4156-bdd0-f61f9d46ce06 req-9e11abea-3121-4ce2-94f6-03324ad7a53b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.948772 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-17beacfe-564f-4156-bdd0-f61f9d46ce06 req-9e11abea-3121-4ce2-94f6-03324ad7a53b service nova] Creating event network-changed:7bf5ff37-42b2-43c4-9059-f47c6c9c6cbe for instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 on hv-cinder-82880 Sep 13 19:51:01.956640 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-17beacfe-564f-4156-bdd0-f61f9d46ce06 req-9e11abea-3121-4ce2-94f6-03324ad7a53b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.499245 Sep 13 19:51:01.961103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 45/91] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:51:01.971921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63585035-5d78-40b3-903f-709758c351eb"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:01.977405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:01.991779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.992284 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.993023 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:01.993923 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:01.994747 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:01.995213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.073509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.093396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-51389d72-2743-4a10-8816-f96f388a8a77 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.283632 Sep 13 19:51:02.099866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 47/92] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:01 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:02.127936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:02.129286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:02.139264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.140110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.140722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.141928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.143458 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.144608 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.469143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.478813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.480521 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.482469 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7ac4ecf2-9bb5-4143-bc93-b0503bc7f14a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.380250 Sep 13 19:51:02.483553 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 48/93] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:02 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:02.661064 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:02.662000 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:02.680267 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.682518 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.683327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.684680 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:02.685937 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:02.686890 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:02.941150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:02.957200 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-89f4e932-e224-4eb5-95e7-45404a5c7158 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.302848 Sep 13 19:51:02.958328 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 49/94] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:02 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:03.123593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:03.124565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:03.138263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.143315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.147208 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.148347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.149020 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.149625 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.414020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f9917329-7fa5-4716-b828-4b2d633eca9d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "POST /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.450437 Sep 13 19:51:03.422433 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 46/95] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:51:01 2022] POST /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a/os-volume_attachments => generated 194 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:03.528512 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:03.529454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:03.541213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.541703 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.542131 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:03.547449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:03.549913 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:03.551074 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.439431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.451518 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7f85a60f-afdc-4acc-8188-0402e2751edd tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 1.332646 Sep 13 19:51:04.453185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 50/96] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:03 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:04.462612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:04.473643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:04.475934 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:04.491783 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.492273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.492703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.493446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.494563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.494988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.567890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.598237 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.601577 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:04.603634 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-57b7bffa-6239-4fe2-8a0a-98ca4077eafd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 1.080156 Sep 13 19:51:04.615769 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 47/97] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:03 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:04.633710 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-81cdb105-1655-4deb-b8d2-b6a3ecbae908 req-99973304-051d-4d80-b1c3-49fb784fa0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd47672-e41a-48a6-a6ca-b89eb476d3a6", "tag": "7b71a18c-2ac5-4fb9-9e78-310505103f18"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:04.654775 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-81cdb105-1655-4deb-b8d2-b6a3ecbae908 req-99973304-051d-4d80-b1c3-49fb784fa0f8 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:04.654775 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-81cdb105-1655-4deb-b8d2-b6a3ecbae908 req-99973304-051d-4d80-b1c3-49fb784fa0f8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:04.655891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-81cdb105-1655-4deb-b8d2-b6a3ecbae908 req-99973304-051d-4d80-b1c3-49fb784fa0f8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:04.677405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-81cdb105-1655-4deb-b8d2-b6a3ecbae908 req-99973304-051d-4d80-b1c3-49fb784fa0f8 service nova] Creating event network-changed:7b71a18c-2ac5-4fb9-9e78-310505103f18 for instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 on hv-cinder-82880 Sep 13 19:51:04.683721 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-81cdb105-1655-4deb-b8d2-b6a3ecbae908 req-99973304-051d-4d80-b1c3-49fb784fa0f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066274 Sep 13 19:51:04.686404 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 48/98] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:05.001112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.010402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e0d491f9-d152-4de5-b8d5-54e8df9ef9fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.555958 Sep 13 19:51:05.015236 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 51/99] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:04 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:05.486391 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:05.488453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:05.500380 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.501322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.502296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.504217 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.504998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.505676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.649406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:05.650633 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:05.658567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.660562 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.661224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.662722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:05.663481 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:05.664334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:05.796518 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.815913 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c842f2f5-d442-45e7-9437-e9766cae6176 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.340073 Sep 13 19:51:05.817927 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 49/100] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:05 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:05.916217 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.925858 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.927326 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:05.928480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a0545c19-b55c-4200-bf96-3e62f09fbe60 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.284608 Sep 13 19:51:05.945314 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 52/101] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:05 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:51:06.036499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.037098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.045130 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.045673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.046308 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.047021 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.047893 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.048553 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.215188 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:06.231680 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6dc116ec-632d-4af4-a0e8-3a4897a0fcdb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.198916 Sep 13 19:51:06.232785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 50/102] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:06.841747 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.846120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.857034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.857912 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.860146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.861273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.862179 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.862898 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.959798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:06.965338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:06.974473 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:06.989859 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.990780 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.992348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:06.993620 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:06.995007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:06.996676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.714352 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.726387 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-98a7071b-4fc9-4c99-8ef8-b5e436d50df9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.886722 Sep 13 19:51:07.727961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 53/103] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:07.747516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:07.748290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:07.776315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.782451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.783111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.783866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.787105 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.787635 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.841379 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.856409 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.857890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:07.859080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1b81b421-a943-47a7-a082-51a4e2b0162f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.905025 Sep 13 19:51:07.859750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 51/104] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:06 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:07.877504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-eeb3662a-a404-43b8-a89c-7de7bf2b7825 req-30629734-3325-48c3-92f4-727543e977a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc2f361-c297-4a69-9898-d4d3cc310118", "name": "network-vif-plugged", "status": "completed", "tag": "8c0ed42f-e532-4877-8eca-a8af525da34e"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:07.909798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-eeb3662a-a404-43b8-a89c-7de7bf2b7825 req-30629734-3325-48c3-92f4-727543e977a7 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:07.912588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-eeb3662a-a404-43b8-a89c-7de7bf2b7825 req-30629734-3325-48c3-92f4-727543e977a7 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:07.914118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-eeb3662a-a404-43b8-a89c-7de7bf2b7825 req-30629734-3325-48c3-92f4-727543e977a7 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:07.950505 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-eeb3662a-a404-43b8-a89c-7de7bf2b7825 req-30629734-3325-48c3-92f4-727543e977a7 service nova] Creating event network-vif-plugged:8c0ed42f-e532-4877-8eca-a8af525da34e for instance 9fc2f361-c297-4a69-9898-d4d3cc310118 on hv-cinder-82880 Sep 13 19:51:07.967109 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-eeb3662a-a404-43b8-a89c-7de7bf2b7825 req-30629734-3325-48c3-92f4-727543e977a7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105234 Sep 13 19:51:07.970786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 52/105] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:08.378952 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:08.425752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-660df861-e554-4aed-ab48-83cbdf1c59a1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.695911 Sep 13 19:51:08.427193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 54/106] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:07 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:08.784242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:08.790070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:08.809786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.811434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.812552 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.815264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.820322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.825608 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.890703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:08.893989 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:08.906419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.907794 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.909530 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.911532 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:08.912221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:08.912875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:08.940493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:09.630111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.645989 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.651379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.655668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7c9ecf13-5224-48fa-8e55-d83b411f6561 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1408 microversion: 2.20 time: 0.774009 Sep 13 19:51:09.659383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 55/107] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:08 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1408 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:09.675509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:09.677142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:09.680189 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.684675 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.685640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.686334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.687554 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:09.688248 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:09.688963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:09.704085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d07ad5de-dd7a-4830-8bc7-e642ac8b207c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.935965 Sep 13 19:51:09.704813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 53/108] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:08 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:09.962831 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:09.973897 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f0037bdd-fcdf-4089-8a41-5aed36ecb2e8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.312559 Sep 13 19:51:09.975131 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 56/109] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:09 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:10.042765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-76a2ab40-1ea2-4e90-9d6c-45d96b256267 req-d6df8946-fa21-4398-96d2-2fffe1910ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4427ca0-6d69-4863-9b14-6b456b1bde67", "name": "network-vif-plugged", "status": "completed", "tag": "d70eb4a9-b50b-433e-bbff-a0640870c674"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:10.077170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-76a2ab40-1ea2-4e90-9d6c-45d96b256267 req-d6df8946-fa21-4398-96d2-2fffe1910ef1 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.077813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-76a2ab40-1ea2-4e90-9d6c-45d96b256267 req-d6df8946-fa21-4398-96d2-2fffe1910ef1 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.078273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-76a2ab40-1ea2-4e90-9d6c-45d96b256267 req-d6df8946-fa21-4398-96d2-2fffe1910ef1 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.102132 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:10.111297 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-76a2ab40-1ea2-4e90-9d6c-45d96b256267 req-d6df8946-fa21-4398-96d2-2fffe1910ef1 service nova] Creating event network-vif-plugged:d70eb4a9-b50b-433e-bbff-a0640870c674 for instance f4427ca0-6d69-4863-9b14-6b456b1bde67 on hv-cinder-82880 Sep 13 19:51:10.117440 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-76a2ab40-1ea2-4e90-9d6c-45d96b256267 req-d6df8946-fa21-4398-96d2-2fffe1910ef1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099846 Sep 13 19:51:10.118260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 54/110] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:10.693662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:10.694642 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:10.715060 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.715060 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.715060 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.715060 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.715582 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.715582 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.755291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:10.756137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:10.778222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.778894 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.779187 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:10.780375 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:10.781313 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:10.782049 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.114500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.124986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.126646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.127979 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fc18ec5f-fdf4-4e50-850f-662de4c41482 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1600 microversion: 2.20 time: 0.440533 Sep 13 19:51:11.129519 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 57/111] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:51:10 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1600 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:51:11.132766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.134867 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:11.135708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:11.143198 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ec887104-f519-4fa4-8caa-c25f91d196db tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.394374 Sep 13 19:51:11.143700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.144213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 55/112] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:10 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:11.144554 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.145200 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.146148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.146590 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.147003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.173784 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:11.174558 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:11.184186 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.184924 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.185534 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.186746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:11.187186 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:11.187599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:11.310174 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b4d2c49a-0993-4e12-9401-7f6faddf61eb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.140481 Sep 13 19:51:11.311272 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 56/113] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Sep 13 19:51:11 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:51:11.376737 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:11.399917 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-29b54fcf-c452-4635-8cda-0f816b29c8da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.269131 Sep 13 19:51:11.401692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 58/114] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:11 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:12.166805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-55a743ce-435a-4954-935c-19b8273f3449 req-c1b3bcc7-0597-44b3-8f44-d3e3b32f247b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd47672-e41a-48a6-a6ca-b89eb476d3a6", "name": "network-vif-plugged", "status": "completed", "tag": "7b71a18c-2ac5-4fb9-9e78-310505103f18"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:12.171347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:12.174551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:12.201864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.202659 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.205360 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.206577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.209705 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.212605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.215681 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-55a743ce-435a-4954-935c-19b8273f3449 req-c1b3bcc7-0597-44b3-8f44-d3e3b32f247b service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.216706 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-55a743ce-435a-4954-935c-19b8273f3449 req-c1b3bcc7-0597-44b3-8f44-d3e3b32f247b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.217877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-55a743ce-435a-4954-935c-19b8273f3449 req-c1b3bcc7-0597-44b3-8f44-d3e3b32f247b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.270691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-55a743ce-435a-4954-935c-19b8273f3449 req-c1b3bcc7-0597-44b3-8f44-d3e3b32f247b service nova] Creating event network-vif-plugged:7b71a18c-2ac5-4fb9-9e78-310505103f18 for instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 on hv-cinder-82880 Sep 13 19:51:12.286489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-55a743ce-435a-4954-935c-19b8273f3449 req-c1b3bcc7-0597-44b3-8f44-d3e3b32f247b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124597 Sep 13 19:51:12.292421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 57/115] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:12.429399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:12.432919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:12.449930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.451973 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.453056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.454854 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:12.457415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:12.460534 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:12.503820 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:12.514624 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0cb2c49a-2af8-4ad1-9aa5-fda5a8c74beb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.351341 Sep 13 19:51:12.515274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 59/116] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:12 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:12.856253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:12.869251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-aa3dc95d-7842-450c-bb16-9ab6859cca63 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.447971 Sep 13 19:51:12.872646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 58/117] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:12 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:13.267960 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.268534 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:13.277900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.278411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.279617 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.281272 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.281970 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.282637 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.325108 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:51:13.545126 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.545890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:13.549196 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:13.571733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.572340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.572989 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.573923 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.574390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.575024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.621055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e81e00e3-7736-4cc0-992a-a434068241a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "DELETE /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 204 len: 0 microversion: 2.1 time: 0.355656 Sep 13 19:51:13.624818 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 60/118] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:51:13 2022] DELETE /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:51:13.649590 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:13.650561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:13.660324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.661180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.662077 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:13.662923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:13.663445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:13.665448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.028208 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.066573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9b6e5deb-8bdf-49c4-aa4e-625137b76e4e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.527891 Sep 13 19:51:14.084654 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 59/119] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:14.093250 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:14.094305 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:14.109511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.112025 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.112795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.114002 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.116831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.120665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.128204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.159249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e9836804-6f32-4816-9a3c-f32379bb71fc tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1553 microversion: 2.1 time: 0.528219 Sep 13 19:51:14.160774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 61/120] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:13 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1553 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:14.187009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-bc8872f4-f73c-46b7-9297-937c6c95b214 req-6333d0e0-0304-4051-a00b-378c25c1c0c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc2f361-c297-4a69-9898-d4d3cc310118", "tag": "8c0ed42f-e532-4877-8eca-a8af525da34e"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:14.236611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-bc8872f4-f73c-46b7-9297-937c6c95b214 req-6333d0e0-0304-4051-a00b-378c25c1c0c6 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.238467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-bc8872f4-f73c-46b7-9297-937c6c95b214 req-6333d0e0-0304-4051-a00b-378c25c1c0c6 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.240010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-bc8872f4-f73c-46b7-9297-937c6c95b214 req-6333d0e0-0304-4051-a00b-378c25c1c0c6 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.266326 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-bc8872f4-f73c-46b7-9297-937c6c95b214 req-6333d0e0-0304-4051-a00b-378c25c1c0c6 service nova] Creating event network-changed:8c0ed42f-e532-4877-8eca-a8af525da34e for instance 9fc2f361-c297-4a69-9898-d4d3cc310118 on hv-cinder-82880 Sep 13 19:51:14.278012 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-bc8872f4-f73c-46b7-9297-937c6c95b214 req-6333d0e0-0304-4051-a00b-378c25c1c0c6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110215 Sep 13 19:51:14.285439 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 62/121] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:14.315187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-d970c94b-bf60-48a4-8cb4-7ae0b1352f1b req-2ef34a59-482e-4057-b147-d52ddd485a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7001c0-8809-4b82-b3f6-354d11c02d14", "name": "network-vif-plugged", "status": "completed", "tag": "7bf5ff37-42b2-43c4-9059-f47c6c9c6cbe"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:14.331795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d970c94b-bf60-48a4-8cb4-7ae0b1352f1b req-2ef34a59-482e-4057-b147-d52ddd485a25 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:14.333735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d970c94b-bf60-48a4-8cb4-7ae0b1352f1b req-2ef34a59-482e-4057-b147-d52ddd485a25 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:14.334660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d970c94b-bf60-48a4-8cb4-7ae0b1352f1b req-2ef34a59-482e-4057-b147-d52ddd485a25 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:14.368370 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-d970c94b-bf60-48a4-8cb4-7ae0b1352f1b req-2ef34a59-482e-4057-b147-d52ddd485a25 service nova] Creating event network-vif-plugged:7bf5ff37-42b2-43c4-9059-f47c6c9c6cbe for instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 on hv-cinder-82880 Sep 13 19:51:14.378178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-d970c94b-bf60-48a4-8cb4-7ae0b1352f1b req-2ef34a59-482e-4057-b147-d52ddd485a25 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065152 Sep 13 19:51:14.384685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 63/122] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:51:14.422445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:14.437069 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-30b17596-6370-46d2-b978-ab18627b4e61 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.356876 Sep 13 19:51:14.438318 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 60/123] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:14 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:15.128422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:15.136675 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:15.149599 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.150274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.155535 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.156295 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.157293 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.157935 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.186154 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:15.189340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:15.212034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.219217 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.219993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.224786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.225711 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.226142 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.659121 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:15.688996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c97db9ef-d71e-4321-a22d-2f23eb882695 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1553 microversion: 2.1 time: 0.504408 Sep 13 19:51:15.689647 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 61/124] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:15 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1553 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:15.720443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:15.721275 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:15.731165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.736568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.737340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.738651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:15.739106 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:15.741361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:15.914620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:15.924266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3b8c55cb-c295-4482-abe9-36d8a3d36dc6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.800600 Sep 13 19:51:15.927893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 64/125] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:15 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:15.999211 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.008337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e2db4f41-4a32-4b14-9d3b-a6be024487f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.308349 Sep 13 19:51:16.025561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 62/126] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:15 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:16.715926 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:16.716954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:16.727032 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.727867 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.728670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.731717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.732851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.734010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.950527 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:16.952105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:16.955973 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:16.960796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.962605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.963224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.964177 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:16.964930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:16.965651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:16.971404 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-adcc6cda-0602-4f3a-83c9-5c1fc5fe61d5 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1553 microversion: 2.1 time: 0.262326 Sep 13 19:51:16.990419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 65/127] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:16 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1553 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:17.032936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.033401 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:17.044166 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.044777 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.045698 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.046500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:17.046925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:17.047396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:17.248287 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.260240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ba1aa5f1-0947-440b-9aee-f25dfd22d80a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1362 microversion: 2.1 time: 0.313508 Sep 13 19:51:17.261853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 63/128] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:16 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:17.378501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:17.393459 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-50d0b5c2-b5cd-49d6-a940-b66a01d63fb6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.364804 Sep 13 19:51:17.394655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 66/129] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:17.996818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:17.997519 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.005106 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.005902 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.006337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.007056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.007508 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.007930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.182006 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.195525 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0e41a544-cd3a-4312-8bb9-27b89ebf3b86 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1553 microversion: 2.1 time: 0.203244 Sep 13 19:51:18.197095 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 64/130] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:17 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:18.287608 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.289617 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.301631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.302145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.302572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.303378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.303826 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.304256 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.428145 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.435239 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.445401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.446042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.446764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.447606 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.448782 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.450488 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.568687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.577288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-16ad91d7-b6e2-4712-82ad-13048e2c6394 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1549 microversion: 2.1 time: 0.295365 Sep 13 19:51:18.577893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 67/131] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1549 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:18.605939 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:18.606354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:18.614648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.615153 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.615662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.620080 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:18.620643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:18.621018 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:18.756613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-eb58a1cf-0db7-4c1d-b349-00b65f748ef2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154383 Sep 13 19:51:18.757807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 68/132] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:18.767905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:18.812906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e8417522-8e05-41dd-8cdc-61e1d21ea988 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.392320 Sep 13 19:51:18.815914 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 65/133] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:18 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:19.227722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.228581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.236266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.236965 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.237575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.238639 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.239097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.239687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.578205 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:19.590045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5fc98f19-dc44-4738-a13b-36d689767d7b tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1553 microversion: 2.1 time: 0.366010 Sep 13 19:51:19.590756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 69/134] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:19.841795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:19.842690 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:19.861988 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.862799 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.863459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:19.865065 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:19.865686 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:19.866268 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.104600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.129801 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-47aa55fa-9b65-49ab-995d-c1b6084c9b9c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1322 microversion: 2.1 time: 0.284961 Sep 13 19:51:20.131200 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 66/135] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:19 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:20.493464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-2721c88e-d8ff-4c07-b5fe-3164b0b61f64 req-e060a7a1-351d-4a12-91b1-7f683d3a2115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c5e80d-5dfc-433b-b9ac-1746a345e69a", "name": "network-vif-deleted", "tag": "db780c10-2ead-4956-b95e-59d864a4cb81"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:20.542499 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-2721c88e-d8ff-4c07-b5fe-3164b0b61f64 req-e060a7a1-351d-4a12-91b1-7f683d3a2115 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.543369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-2721c88e-d8ff-4c07-b5fe-3164b0b61f64 req-e060a7a1-351d-4a12-91b1-7f683d3a2115 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.549049 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-2721c88e-d8ff-4c07-b5fe-3164b0b61f64 req-e060a7a1-351d-4a12-91b1-7f683d3a2115 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.564564 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-2721c88e-d8ff-4c07-b5fe-3164b0b61f64 req-e060a7a1-351d-4a12-91b1-7f683d3a2115 service nova] Creating event network-vif-deleted:db780c10-2ead-4956-b95e-59d864a4cb81 for instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a on hv-cinder-82880 Sep 13 19:51:20.583236 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-2721c88e-d8ff-4c07-b5fe-3164b0b61f64 req-e060a7a1-351d-4a12-91b1-7f683d3a2115 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094737 Sep 13 19:51:20.587832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 70/136] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:20.616652 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:20.617363 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:20.629096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.629588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.630024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.630736 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:20.631222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:20.631668 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:20.728805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:20.744869 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dfbb77c5-8c04-403a-b2b2-b9833d58807d tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1511 microversion: 2.1 time: 0.132077 Sep 13 19:51:20.758046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 67/137] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:20 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1511 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:21.178349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:21.180142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.190330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.191240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.192036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.193655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.194511 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.195197 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.476648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.492303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d50e12b6-62a6-4636-9b8a-6223358fc443 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1517 microversion: 2.1 time: 0.331014 Sep 13 19:51:21.498977 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 71/138] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:21 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1517 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:21.539249 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:21.544576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.555967 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.556732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.557772 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.559114 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.561035 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.561973 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.610641 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'flavor' on Instance uuid 1f7001c0-8809-4b82-b3f6-354d11c02d14 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:51:21.771634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:21.773233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.785434 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.787028 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.787931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.789914 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.790636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.791247 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.929095 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:21.936227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:21.944482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1a341e7f-131c-49d8-906b-b0d73fdf54d7 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1345 microversion: 2.1 time: 0.177639 Sep 13 19:51:21.946764 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 72/139] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:21 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1345 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:21.947937 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3c20777c-e046-4f3e-9571-d0d41957fd44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14/action" status: 200 len: 32 microversion: 2.1 time: 0.416038 Sep 13 19:51:21.952195 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 68/140] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:51:21 2022] POST /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:51:21.970524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:21.971239 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:21.988408 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.988939 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.989367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:21.995994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:21.996485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:21.996949 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.636287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:22.636990 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-db658317-a344-4475-acdf-5e021c9b28ed req-83aa10aa-b02d-4722-9db3-9583a05a35ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd47672-e41a-48a6-a6ca-b89eb476d3a6", "tag": "7b71a18c-2ac5-4fb9-9e78-310505103f18"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:22.653179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-db658317-a344-4475-acdf-5e021c9b28ed req-83aa10aa-b02d-4722-9db3-9583a05a35ed service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:22.656774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a3279283-c89f-46ed-8c13-250aca70d1b0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.700989 Sep 13 19:51:22.657549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-db658317-a344-4475-acdf-5e021c9b28ed req-83aa10aa-b02d-4722-9db3-9583a05a35ed service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:22.658051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 73/141] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:21 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:22.658460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-db658317-a344-4475-acdf-5e021c9b28ed req-83aa10aa-b02d-4722-9db3-9583a05a35ed service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:22.679130 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-db658317-a344-4475-acdf-5e021c9b28ed req-83aa10aa-b02d-4722-9db3-9583a05a35ed service nova] Creating event network-changed:7b71a18c-2ac5-4fb9-9e78-310505103f18 for instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 on hv-cinder-82880 Sep 13 19:51:22.685785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-db658317-a344-4475-acdf-5e021c9b28ed req-83aa10aa-b02d-4722-9db3-9583a05a35ed service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053432 Sep 13 19:51:22.692604 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 69/142] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:51:22.981678 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:22.983803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:23.011489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.018051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.033601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.053774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.055662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.058659 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.185984 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.186466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.186894 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.187579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lazy-loading 'fault' on Instance uuid 34c5e80d-5dfc-433b-b9ac-1746a345e69a {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:51:23.271378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f98fd1481406494e995df1128897415f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd86336ff2858481ea24231bfb10775f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:23.282550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e94233a7-9d06-468a-ac31-6144b98c75a0 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 200 len: 1350 microversion: 2.1 time: 0.311805 Sep 13 19:51:23.282550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 74/143] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:22 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 1350 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:23.700531 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:23.701897 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:23.715143 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.715832 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.716960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:23.718330 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:23.720049 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:23.720945 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.031295 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:24.053764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a093d645-3077-403e-a828-df999e1f866e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.360849 Sep 13 19:51:24.060208 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 70/144] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:23 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:24.324097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.332997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:24.349940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.350470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.350891 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.351619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.352081 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.352511 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.374624 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] HTTP exception thrown: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Request method failure captured: Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a HTTP/1.1 Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN72ZsROfhpNNo6eKLUmzRrpVxWOxmvQmQBCjUy8zYBgvHDdYV4jvEJqaruBWKqAgl4SCQHxiM1O5QVxTx77lN80Y5y8ucFBwmkQkAyk8HsbRfYZq5AmTZieAt5WxHjo9DCPqrdXRDMkcTHJ2CtPtWye0P6EwjJ6mpsd_QjZdtIfZlI Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:51:24.379955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d86336ff2858481ea24231bfb10775f1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}] Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: f98fd1481406494e995df1128897415f Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.381443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '34c5e80d-5dfc-433b-b9ac-1746a345e69a'} Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:24.382489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.383893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.385985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Returning 404 to user: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:24.386954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-04233c33-f541-45ee-85a5-822b4d9cf001 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 404 len: 111 microversion: 2.1 time: 0.067383 Sep 13 19:51:24.387789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 75/145] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:51:24.624703 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:24.627486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:24.634176 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.634675 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.635247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.635982 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:24.636470 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:24.636938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:24.640433 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:24.654172 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] HTTP exception thrown: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Request method failure captured: Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a/os-volume_attachments HTTP/1.1 Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN72ZsROfhpNNo6eKLUmzRrpVxWOxmvQmQBCjUy8zYBgvHDdYV4jvEJqaruBWKqAgl4SCQHxiM1O5QVxTx77lN80Y5y8ucFBwmkQkAyk8HsbRfYZq5AmTZieAt5WxHjo9DCPqrdXRDMkcTHJ2CtPtWye0P6EwjJ6mpsd_QjZdtIfZlI Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:51:24.670243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d86336ff2858481ea24231bfb10775f1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}] Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: f98fd1481406494e995df1128897415f Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.671739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'server_id': '34c5e80d-5dfc-433b-b9ac-1746a345e69a'} Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:24.672786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:24.674266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:24.675722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Returning 404 to user: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:24.675722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4ddad543-805e-48ae-bbd2-c6846b01d764 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051736 Sep 13 19:51:24.675722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 71/146] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:51:24 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:51:25.085931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:25.086553 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:25.093389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.094149 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.094799 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.095708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.096156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.096573 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.268929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:25.280228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f40a5e1f-ab4e-40cd-abe0-f86be8101e0b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.198641 Sep 13 19:51:25.296921 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 76/147] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:25 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:25.946496 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:25.947751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:25.958713 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.959635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.960274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.961244 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:25.961915 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:25.962435 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:25.985691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] HTTP exception thrown: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Request method failure captured: Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: DELETE /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a HTTP/1.1 Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN72ZsROfhpNNo6eKLUmzRrpVxWOxmvQmQBCjUy8zYBgvHDdYV4jvEJqaruBWKqAgl4SCQHxiM1O5QVxTx77lN80Y5y8ucFBwmkQkAyk8HsbRfYZq5AmTZieAt5WxHjo9DCPqrdXRDMkcTHJ2CtPtWye0P6EwjJ6mpsd_QjZdtIfZlI Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:51:25.989102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d86336ff2858481ea24231bfb10775f1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}] Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: f98fd1481406494e995df1128897415f Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:25.990415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '34c5e80d-5dfc-433b-b9ac-1746a345e69a'} Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:25.991164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:25.992573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:51:25.995576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Returning 404 to user: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:25.996871 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b760ffbb-24c1-4f8b-b028-a4d1f11108dd tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "DELETE /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 404 len: 111 microversion: 2.1 time: 0.056119 Sep 13 19:51:25.997916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 72/148] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:51:25 2022] DELETE /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:51:26.010643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:26.012251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] [instance: 34c5e80d-5dfc-433b-b9ac-1746a345e69a] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:26.041158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.041742 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.042466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.043511 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.044045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.044559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.061529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] HTTP exception thrown: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Request method failure captured: Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a HTTP/1.1 Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN72ZsROfhpNNo6eKLUmzRrpVxWOxmvQmQBCjUy8zYBgvHDdYV4jvEJqaruBWKqAgl4SCQHxiM1O5QVxTx77lN80Y5y8ucFBwmkQkAyk8HsbRfYZq5AmTZieAt5WxHjo9DCPqrdXRDMkcTHJ2CtPtWye0P6EwjJ6mpsd_QjZdtIfZlI Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:51:26.063775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d86336ff2858481ea24231bfb10775f1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d86336ff2858481ea24231bfb10775f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d86336ff2858481ea24231bfb10775f1"}]}] Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d86336ff2858481ea24231bfb10775f1 Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-DeleteServersTestJSON-463223474 Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: f98fd1481406494e995df1128897415f Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-DeleteServersTestJSON-463223474-project Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:26.064985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '34c5e80d-5dfc-433b-b9ac-1746a345e69a'} Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:26.065670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. Sep 13 19:51:26.066749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:26.067851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] Returning 404 to user: Instance 34c5e80d-5dfc-433b-b9ac-1746a345e69a could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:26.067851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c9d243f2-5905-4d3a-bb41-b94ce88f0b33 tempest-DeleteServersTestJSON-463223474 tempest-DeleteServersTestJSON-463223474-project] 10.222.0.18 "GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a" status: 404 len: 111 microversion: 2.1 time: 0.061591 Sep 13 19:51:26.067851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 77/149] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:26 2022] GET /compute/v2.1/servers/34c5e80d-5dfc-433b-b9ac-1746a345e69a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:51:26.306655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:26.308687 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:26.316415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.317819 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.318806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.323068 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:26.324075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:26.324872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:26.568992 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:26.580343 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-91285a2a-e7e8-4a75-880e-0d698ebbfdf5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.278743 Sep 13 19:51:26.580956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 73/150] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:26 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:27.618565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:27.620432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:27.633043 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:27.634178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:27.635430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:27.636355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:27.639296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:27.639296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:27.859162 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:27.867603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0d2063c7-ec1d-4d0d-8395-db05e8ae1dfb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.255302 Sep 13 19:51:27.868190 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 78/151] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:27 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:28.892472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:28.893325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:28.913438 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.914420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.915600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:28.917649 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:28.919314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:28.920062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:29.349489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:29.372178 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-34476cbc-eed3-4319-a244-f3c904526974 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.483981 Sep 13 19:51:29.373196 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 74/152] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:28 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:30.399286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:30.399986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:30.415470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:30.417529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:30.418215 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:30.419801 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:30.421152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:30.422726 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:30.839201 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:30.854370 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7e31f988-4578-48e0-bcf7-933424602a03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.461140 Sep 13 19:51:30.869985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 79/153] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:30 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:31.890579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:31.891651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:31.898119 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:31.898676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:31.899803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:31.900607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:31.901642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:31.902314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:32.092531 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:32.103988 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0f371ef5-6ab3-482d-8bdd-1e89c81a6948 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.213782 Sep 13 19:51:32.103988 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 75/154] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:31 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:33.133727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:33.135004 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:33.142622 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:33.143451 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:33.144339 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:33.145316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:33.145786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:33.146214 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:33.337691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:33.353088 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f5e1b87f-60af-4288-8895-42467c745ba7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.222672 Sep 13 19:51:33.353636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 76/155] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:33 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:33.515501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-04e6a26e-ef15-4d7d-be0e-d36599565fa8 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Action: 'create', calling method: .version_select at 0x7f98b6c06d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1278868872", "metadata": {"Type": "work"}}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:34.020668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-04e6a26e-ef15-4d7d-be0e-d36599565fa8 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.954867 Sep 13 19:51:34.022013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 80/156] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 19:51:33 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 957 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 19:51:34.039295 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a31230c5-1ca0-4a72-87a9-254a9aa952d8 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Calling method '.version_select at 0x7f98b6bd89d0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:34.151597 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a31230c5-1ca0-4a72-87a9-254a9aa952d8 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef" status: 200 len: 353 microversion: 2.1 time: 0.119874 Sep 13 19:51:34.152947 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 77/157] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:51:34 2022] GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:34.397676 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:34.398429 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:34.406556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:34.407246 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:34.407879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:34.408729 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:34.409547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:34.409664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:34.588414 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:34.608043 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4bca4a24-d111-42fe-ad26-2addcc21c8cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.215379 Sep 13 19:51:34.609681 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 81/158] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:34 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:35.169068 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-41e00957-20ac-43d7-adde-4c92c51ed7d1 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Calling method '.version_select at 0x7f98b6d7d940>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:35.281726 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-41e00957-20ac-43d7-adde-4c92c51ed7d1 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef" status: 200 len: 354 microversion: 2.1 time: 0.118272 Sep 13 19:51:35.297143 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 78/159] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:51:35 2022] GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:35.298667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-42ac63a7-a6a1-40ef-ad47-8b3c34c39dc9 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Calling method '.version_select at 0x7f98b6c61940>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:35.395469 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-42ac63a7-a6a1-40ef-ad47-8b3c34c39dc9 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef" status: 200 len: 354 microversion: 2.1 time: 0.103074 Sep 13 19:51:35.396306 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 82/160] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:51:35 2022] GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:35.420192 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-691249f9-d986-4ee8-a38d-35a9b61f4243 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Calling method '.version_select at 0x7f98b6b92160>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:35.537797 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-691249f9-d986-4ee8-a38d-35a9b61f4243 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef" status: 202 len: 0 microversion: 2.1 time: 0.123279 Sep 13 19:51:35.538796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 79/161] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 19:51:35 2022] DELETE /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:51:35.554815 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ad1681ad-2e9a-4fed-8242-e3ede0b97a90 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Calling method '.version_select at 0x7f98b6c81430>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:35.651675 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:35.652602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:35.657116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ad1681ad-2e9a-4fed-8242-e3ede0b97a90 tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef" status: 200 len: 353 microversion: 2.1 time: 0.111529 Sep 13 19:51:35.657927 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 83/162] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:51:35 2022] GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:51:35.662019 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:35.662729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:35.663305 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:35.665199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:35.665794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:35.666286 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:35.841570 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:35.851361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-be7ba112-e6eb-4838-abc8-9dac92a40f49 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.205970 Sep 13 19:51:35.853247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 80/163] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:35 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:36.672788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8b63c907-b310-471c-a1b5-481aa307429e tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Calling method '.version_select at 0x7f98b6c81820>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:36.714443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-8b63c907-b310-471c-a1b5-481aa307429e tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] HTTP exception thrown: Volume b49d75bb-7c8f-4161-9378-c1ca6cedd9ef could not be found. Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8b63c907-b310-471c-a1b5-481aa307429e tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Request method failure captured: Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef HTTP/1.1 Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN9Ea7UQFZEp0Gt3_DSc3OLDAACNK-P-QFfcczUJMRZVgE3zwqwDsCrC_f2y7uAsovCA5gxAS0OX1jS1zf4GLd0tme_e4rdXDDFtMiiLHAJ_OE1oEpzvi4wGckC0YJIbX5559W7vm89TY-eV9l-xlh3eV47ugPLjzHPL68-5AOvn7sk Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: f18376d078a94034a751fa626a7f99be Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesGetTestJSON-302844292 Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:51:36.716824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f18376d078a94034a751fa626a7f99be"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_f18376d078a94034a751fa626a7f99be", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/f18376d078a94034a751fa626a7f99be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/f18376d078a94034a751fa626a7f99be"}]}] Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesGetTestJSON-302844292 Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: f18376d078a94034a751fa626a7f99be Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesGetTestJSON-302844292 Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesGetTestJSON-302844292-project Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: d76be17fd480416595e26ba6d2f1a96d Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesGetTestJSON-302844292-project Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Volume b49d75bb-7c8f-4161-9378-c1ca6cedd9ef could not be found. Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'b49d75bb-7c8f-4161-9378-c1ca6cedd9ef'} Sep 13 19:51:36.718319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b49d75bb-7c8f-4161-9378-c1ca6cedd9ef could not be found. (HTTP 404) (Request-ID: req-f2c82f8e-45a8-4131-9e2f-51f8372ac8ff) Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:36.719233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 19:51:36.720588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b49d75bb-7c8f-4161-9378-c1ca6cedd9ef could not be found. Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 19:51:36.721957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b49d75bb-7c8f-4161-9378-c1ca6cedd9ef could not be found. Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b49d75bb-7c8f-4161-9378-c1ca6cedd9ef could not be found. Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8b63c907-b310-471c-a1b5-481aa307429e tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] Returning 404 to user: Volume b49d75bb-7c8f-4161-9378-c1ca6cedd9ef could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8b63c907-b310-471c-a1b5-481aa307429e tempest-VolumesGetTestJSON-302844292 tempest-VolumesGetTestJSON-302844292-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef" status: 404 len: 109 microversion: 2.1 time: 0.051498 Sep 13 19:51:36.723276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 84/164] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:51:36 2022] GET /compute/v2.1/os-volumes/b49d75bb-7c8f-4161-9378-c1ca6cedd9ef => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:51:36.876559 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:36.877212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:36.884288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.884774 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.885232 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:36.885934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:36.886558 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:36.887870 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:37.069999 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:37.078144 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-99b5f97b-bf53-4d9a-92e6-9814c077bed5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.206244 Sep 13 19:51:37.079086 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 81/165] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:36 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:38.101417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:38.102106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:38.103962 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:38.111117 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.111766 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.112379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.113289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:38.113978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:38.114745 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:38.316224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:38.332145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f419f801-4d50-41b2-a167-031d2626a7cb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.233587 Sep 13 19:51:38.332986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 85/166] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:38 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:39.358799 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:39.360299 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:39.369223 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:39.370008 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:39.370675 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:39.371664 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:39.372511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:39.373251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:39.529591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:39.539368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-54a9a75c-13c0-4219-99e7-da9e7d00c9b1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.187263 Sep 13 19:51:39.541690 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 82/167] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:39 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:40.565159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:40.566522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:40.576631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:40.577903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:40.579016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:40.580168 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:40.580766 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:40.581769 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:40.752750 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:40.761770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a77a225e-f212-45e5-857a-aa45f659ca7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.202078 Sep 13 19:51:40.762573 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 86/168] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:40 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:41.787087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:41.787691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:41.794698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:41.795178 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:41.795601 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:41.796288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:41.796728 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:41.797149 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:41.935598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:41.943693 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2fe19ad3-6151-4f5e-9f45-05a9a5495f1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.160941 Sep 13 19:51:41.944424 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 83/169] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:41 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:42.976308 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:42.976974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:42.983181 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:42.983686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:42.984101 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:42.984879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:42.985361 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:42.985777 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:43.120239 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:43.128079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ddd4b6b4-9b6d-4471-b306-fca4feb3337a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.165273 Sep 13 19:51:43.128938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 87/170] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:42 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:44.154623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:44.155246 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:44.157711 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=44 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:44.163614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:44.164089 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:44.164515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:44.165240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:44.165711 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:44.166103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:44.299249 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:44.307429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bb9f3606-6d29-479a-be72-7e48495e0e86 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.156774 Sep 13 19:51:44.308041 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 84/171] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:44 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:45.333334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:45.333941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:45.340842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:45.341378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:45.341813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:45.342524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:45.342973 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:45.343395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:45.689771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:45.697897 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8c9d76af-1aac-4442-b5e3-a9bca5ccac7d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.368649 Sep 13 19:51:45.698488 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 88/172] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:45 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:46.721304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:46.721911 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:46.728515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:46.729020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:46.729445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:46.730136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:46.730573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:46.730981 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:46.865903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:46.873934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e29270ce-8123-4ca4-a6f3-20632ddd4edb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.156627 Sep 13 19:51:46.874559 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 85/173] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:46 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:47.897426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:47.898037 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:47.905433 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.906095 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.906517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:47.907213 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:47.907751 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:47.908277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:48.050292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:48.058155 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-37d2fab7-1d15-42a5-a6fa-7584ccbbf8bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.164895 Sep 13 19:51:48.058732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 89/174] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:47 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:49.081200 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:49.081804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:49.088377 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:49.088876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:49.089406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:49.090084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:49.090535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:49.090938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:49.221481 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:49.229277 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7010c372-b60d-4644-9f02-eb9c88779498 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.152086 Sep 13 19:51:49.229877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 86/175] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:49 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:50.251933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:50.252510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:50.259050 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:50.259533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:50.259959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:50.260776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:50.261278 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:50.261778 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:50.400049 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:50.408366 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0481da5e-a8b6-4475-9992-51d67f7fbb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.160308 Sep 13 19:51:50.408975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 90/176] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:50 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:51.433000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:51.433618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:51.441518 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:51.442039 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:51.442529 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:51.443292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:51.443753 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:51.444171 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:51.586537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:51.594826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-43c36a48-2c0d-4c1a-a7e4-d2910922734c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.166514 Sep 13 19:51:51.595396 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 87/177] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:51 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:52.049462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-434190280", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:51:52.102865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] validate_networks() for None {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:51:52.419857 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:51:52.420388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:51:52.420993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:51:52.421288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:51:52.422535 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:51:52.431738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:52.432225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:52.432711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:52.433388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:52.434237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:52.434710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:52.440974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=80 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:52.456029 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Getting quotas for project 62ad20021ed0483186dad6591ba5ce67. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:51:52.462153 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Getting quotas for user 299a8c2de0cf4f0aa1570c718fe04e52 and project 62ad20021ed0483186dad6591ba5ce67. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:51:52.475344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:51:52.477908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:51:52.536360 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1d501d3f-389b-4deb-a2df-7de728f83b54 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490688 Sep 13 19:51:52.537476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 91/178] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:51:52.548822 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2019989f-065f-4e8a-aba7-8f65496f4c52 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:52.549647 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2019989f-065f-4e8a-aba7-8f65496f4c52 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:52.619667 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2019989f-065f-4e8a-aba7-8f65496f4c52 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:52.620347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:52.621388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:52.628593 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2019989f-065f-4e8a-aba7-8f65496f4c52 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1214 microversion: 2.1 time: 0.083527 Sep 13 19:51:52.633098 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:52.634432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:52.635941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:52.638138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:52.638948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:52.639598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:52.644354 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 88/179] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:52 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:52.809338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:52.817393 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b4cfe52e-e33d-4630-b1fc-45274445d0af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.202973 Sep 13 19:51:52.817977 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 92/180] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:52 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:53.660105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:53.660742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:53.668200 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:53.668687 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:53.669139 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:53.669839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:53.670282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:53.670727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:53.732381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:53.740340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b30ff31f-3f45-45af-8971-483f0d29bf38 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1218 microversion: 2.1 time: 0.084137 Sep 13 19:51:53.741071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 89/181] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:53 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:53.845353 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:53.845954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:53.854649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:53.855521 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:53.856160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:53.857299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:53.858032 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:53.858728 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:54.012696 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:54.020953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e9ca91fd-1898-4039-a923-3019e59b2f57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.182855 Sep 13 19:51:54.021894 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 93/182] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:53 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:54.763888 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:54.764460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:54.771529 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:54.772010 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:54.772440 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:54.773193 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:54.773643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:54.774064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:54.836600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:54.844709 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7dbc584c-982b-448b-b449-d04e00c66aec tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1218 microversion: 2.1 time: 0.084834 Sep 13 19:51:54.845452 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 90/183] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:54 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:55.046401 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:55.047004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:55.054492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:55.054988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:55.055419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:55.056129 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:55.056583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:55.057040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:55.201892 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:55.210572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-293ad274-9ebd-4682-b358-a1e26356dfa9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.168211 Sep 13 19:51:55.211145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 94/184] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:55 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:51:55.868063 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:55.868666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:55.876400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:55.876915 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:55.877346 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:55.878049 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:55.878497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:55.879024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:55.959023 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:55.967053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8b1684dc-017e-4bc2-be71-72df749ae620 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1274 microversion: 2.1 time: 0.102953 Sep 13 19:51:55.967626 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 91/185] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:55 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:56.234466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:56.235124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:56.241711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:56.242203 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:56.242660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:56.243364 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:56.243807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:56.244263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:56.378812 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:56.388678 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3fa52c1c-2b81-4261-a60f-d69e9e2ae225 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.158390 Sep 13 19:51:56.389321 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 95/186] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:56 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:57.002439 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:57.003368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:57.016384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:57.016983 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:57.017721 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:57.018501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:57.018958 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:57.020528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:57.050861 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=94 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:51:57.347477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:57.363324 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bf23333a-60ae-4961-a717-9069617b8a62 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.371215 Sep 13 19:51:57.376915 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 92/187] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:56 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:57.416924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:57.417444 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:57.425336 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:57.426054 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:57.426690 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:57.427581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:57.428083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:57.428425 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:57.569928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:57.577948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ead69135-6ba9-4916-8433-51b4493de7bd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.167833 Sep 13 19:51:57.578524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 96/188] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:57 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:58.387570 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:58.388182 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:58.395030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:58.395519 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:58.395939 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:58.396632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:58.397138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:58.397554 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:58.539219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:58.547400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4355c1c0-68b1-4485-bc80-d0b23ff7e254 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.163659 Sep 13 19:51:58.548082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 93/189] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:58 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:58.601069 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:58.601719 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:58.608431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:58.608954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:58.609389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:58.610224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:58.610549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:58.610968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:58.747559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:58.755468 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-20e00667-39c3-4330-bcb4-5bbaf364618d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.158423 Sep 13 19:51:58.756021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 97/190] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:58 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:59.570471 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:59.571038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:59.577909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:59.578402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:59.578827 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:59.579526 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:59.579969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:59.580388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:59.713554 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:59.722006 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-95ccda4f-81a4-4c0f-8ebe-64f277b3a5be tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.155491 Sep 13 19:51:59.722708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 94/191] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:59 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:51:59.778858 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:51:59.779420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:51:59.785883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:59.786369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:59.786789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:59.787474 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:51:59.788277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:51:59.788688 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:51:59.922229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:51:59.930302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8623b499-a46d-4e04-a9a1-1c107b63c126 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.155514 Sep 13 19:51:59.930893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 98/192] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:51:59 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:00.745005 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:00.745580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:00.752348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:00.752833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:00.753283 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:00.753966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:00.754380 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:00.754853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:00.890716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:00.898556 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-66fe5bec-3c66-4a83-bcdd-883d1c9aa0bc tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.157520 Sep 13 19:52:00.899124 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 95/193] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:00 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:00.953374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:00.953964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:00.960605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:00.961134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:00.961572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:00.962261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:00.962711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:00.963131 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:01.100638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:01.108616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-30ad89b1-1a88-46bc-b656-0cf39df5fd87 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.159169 Sep 13 19:52:01.109207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 99/194] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:00 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:01.921898 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:01.922477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:01.931489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:01.932171 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:01.932767 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:01.934128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:01.934750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:01.935313 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:02.072615 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:02.082898 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e7a1fa0a-aa55-4243-bd5f-1b478ad2b5a3 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.164609 Sep 13 19:52:02.083638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 96/195] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:01 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:02.132274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:02.132906 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:02.139864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:02.140351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:02.140777 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:02.141505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:02.141954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:02.142542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:02.281612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:02.290118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a82e77b0-d921-4053-b703-5b44c21206e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.162301 Sep 13 19:52:02.290711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 100/196] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:02 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:03.106275 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:03.106841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:03.108932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:03.114730 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:03.115187 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:03.115613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:03.116365 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:03.116731 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:03.117162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:03.253550 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:03.261814 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b4283d15-c9b8-44f1-8128-d034fa348fa2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.159472 Sep 13 19:52:03.262384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 97/197] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:03 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:03.312919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:03.313486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:03.315426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:03.316396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:03.321924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:03.322416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:03.322852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:03.323555 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:03.324035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:03.324437 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:03.510775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:03.524310 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-349089a0-659c-40b6-bc7f-3c6a6dd0ce6a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.215169 Sep 13 19:52:03.525333 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 101/198] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:03 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:04.004439 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-6cffb30f-14a8-470d-bd3f-589f84068d2c req-14b6723d-46bb-4e5a-8e4e-b69fa74c5c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff13d54-7974-4ebf-80de-7b14e4eb473b", "tag": "d02aaf84-ef9f-498c-8f0a-bf8c4e34c571"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:04.014485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-6cffb30f-14a8-470d-bd3f-589f84068d2c req-14b6723d-46bb-4e5a-8e4e-b69fa74c5c5e service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:04.014874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-6cffb30f-14a8-470d-bd3f-589f84068d2c req-14b6723d-46bb-4e5a-8e4e-b69fa74c5c5e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:04.015294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-6cffb30f-14a8-470d-bd3f-589f84068d2c req-14b6723d-46bb-4e5a-8e4e-b69fa74c5c5e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:04.035139 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-6cffb30f-14a8-470d-bd3f-589f84068d2c req-14b6723d-46bb-4e5a-8e4e-b69fa74c5c5e service nova] Creating event network-changed:d02aaf84-ef9f-498c-8f0a-bf8c4e34c571 for instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b on hv-cinder-82880 Sep 13 19:52:04.041208 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-6cffb30f-14a8-470d-bd3f-589f84068d2c req-14b6723d-46bb-4e5a-8e4e-b69fa74c5c5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041366 Sep 13 19:52:04.041952 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 98/199] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:04.288250 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:04.288742 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:04.296258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:04.298084 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:04.298084 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:04.298805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:04.299532 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:04.300236 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:04.455749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:04.464066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f976b941-d1ba-4514-8799-649d54618a33 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.181250 Sep 13 19:52:04.464702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 102/200] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:04 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:04.549394 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:04.550098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:04.556872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:04.557382 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:04.557811 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:04.558502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:04.558947 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:04.559366 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:04.849047 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:04.858686 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-25089957-0648-47f5-943a-f3c088ca9925 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.314402 Sep 13 19:52:04.859227 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 99/201] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:04 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:05.486862 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:05.487467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:05.494126 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:05.494611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:05.495389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:05.495723 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:05.496166 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:05.496582 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:05.631128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:05.639417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0302ea90-4507-4520-8ce1-66e97eee2ea6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.156380 Sep 13 19:52:05.640008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 103/202] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:05 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:05.881601 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:05.882157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:05.889775 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:05.890269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:05.890702 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:05.891409 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:05.891862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:05.892284 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:06.023361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:06.031451 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d8f6aa61-8bcd-446a-acfd-7798a90dce32 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.153805 Sep 13 19:52:06.032041 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 100/203] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:05 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:06.663666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:06.664296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:06.670533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:06.671012 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:06.671435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:06.672116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:06.672557 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:06.672994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:06.808068 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:06.816619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-211bf3b6-1168-4ed6-8a5b-bf082e6958a6 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.157249 Sep 13 19:52:06.817274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 104/204] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:06 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:07.055353 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:07.055941 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:07.063036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:07.063523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:07.063948 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:07.064646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:07.065166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:07.065584 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:07.199643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:07.207984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ba56dda8-6853-474c-8ef4-498e051f5b1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.156512 Sep 13 19:52:07.208587 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 101/205] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:07 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:07.840213 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:07.840832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:07.847526 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:07.848024 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:07.848458 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:07.849199 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:07.849659 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:07.850075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:07.987274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:07.995758 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a18bbcf4-56cd-4fba-a509-27ee34874cdb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.159590 Sep 13 19:52:07.996565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 105/206] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:07 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:08.235714 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:08.236381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:08.243427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:08.243918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:08.244350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:08.245123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:08.245576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:08.246027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:08.380269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:08.388294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1e5cd95d-afd1-4dca-9de4-a457e60c823c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.156582 Sep 13 19:52:08.388872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 102/207] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:08 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:09.019435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:09.019994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:09.021943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:09.027864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:09.028459 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:09.028901 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:09.029841 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:09.030289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:09.030710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:09.162055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:09.170253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-45a62116-77fa-4f0e-a066-d57b913971f8 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.154903 Sep 13 19:52:09.170875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 106/208] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:09 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:09.411783 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:09.412973 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:09.419935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:09.420415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:09.420837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:09.421561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:09.421992 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:09.422419 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:09.558542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:09.566686 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a1251cda-ae28-4b57-a0a3-9f5497f720da tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1523 microversion: 2.1 time: 0.158803 Sep 13 19:52:09.567436 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 103/209] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:09 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:10.194224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:10.195453 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:10.201177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.201694 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.202120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.202810 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.203251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.203664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.345859 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:10.353962 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d437fbb1-d199-4a15-b838-e0a4682c5590 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.164032 Sep 13 19:52:10.354558 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 107/210] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:10 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:10.590812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:10.591550 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:10.598917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.599391 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.599821 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.600527 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.601007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.601472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.753310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:10.763395 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-82e82bae-03e5-45fb-b4fa-8c05f651e79e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1503 microversion: 2.1 time: 0.176546 Sep 13 19:52:10.764466 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 104/211] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:10 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:10.787087 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:10.789070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:10.797044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.797661 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.798171 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.798925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:10.799422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:10.799848 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:10.820310 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:10.988276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:11.004796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d62bd5a0-4b9d-4687-9395-7353194dfc59 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1516 microversion: 2.1 time: 0.221306 Sep 13 19:52:11.007101 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 108/212] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:10 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:11.383348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:11.386248 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:11.402057 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:11.403229 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:11.403971 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:11.405260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:11.406302 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:11.407471 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:11.617946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:11.627966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-28e52342-6ec5-465b-8dad-9df95d229d86 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.252021 Sep 13 19:52:11.628722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 105/213] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:11 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:12.653037 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:12.654073 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:12.661394 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:12.661888 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:12.662684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:12.663452 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:12.664083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:12.664509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:12.807818 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:12.816243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e733f993-6d5c-47cd-a535-6923fecd25f1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.168194 Sep 13 19:52:12.816835 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 109/214] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:12 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:13.840851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:13.841917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:13.853478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:13.854316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:13.855044 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:13.856537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:13.856825 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:13.857593 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:14.015462 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:14.027806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-edc565b3-244a-4152-994e-87bcc8221380 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.189412 Sep 13 19:52:14.027806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 106/215] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:13 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:15.047656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:15.048285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:15.055041 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.055538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.055975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.056677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.057149 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.057611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.192460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:15.205211 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5ec5b75f-36ca-4689-a6af-c60ec30e2951 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.159240 Sep 13 19:52:15.206298 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 110/216] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:15 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:15.714159 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:15.716641 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:15.719035 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=48 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:15.724470 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.724968 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.725623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.726323 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.726788 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.727210 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.751102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'flavor' on Instance uuid f4427ca0-6d69-4863-9b14-6b456b1bde67 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:15.806360 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:15.829354 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-66818724-74cb-4678-91d1-474bc3cc74b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67/action" status: 200 len: 32 microversion: 2.1 time: 0.119146 Sep 13 19:52:15.829972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 107/217] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:52:15 2022] POST /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:52:15.840297 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:15.840936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:15.847130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.847616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.848044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.848730 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:15.849207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:15.849625 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:15.998185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:16.009072 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9fba270e-c0d2-4f8b-b8c9-8c4111b21178 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.172538 Sep 13 19:52:16.009666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 111/218] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:15 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:16.230318 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:16.231967 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:16.242269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:16.242966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:16.243609 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:16.244525 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:16.245199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:16.247344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:16.446675 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:16.455359 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-55ea3dcf-db02-484e-baff-72ce95689c7b tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.230734 Sep 13 19:52:16.455944 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 108/219] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:16 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:17.039684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:17.040389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:17.047536 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.048104 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.048544 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.049285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.049739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.050263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.202915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:17.212448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-031734fc-fa68-41d3-906a-86480d4a8079 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.180548 Sep 13 19:52:17.213060 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 112/220] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:17 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:17.479057 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:17.479731 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:17.486899 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.487389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.487887 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.488591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:17.489073 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:17.489506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:17.624022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:17.632170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2fbd9da6-9f71-4bf8-93f6-950436cd202c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.156966 Sep 13 19:52:17.648066 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 109/221] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:17 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:18.236031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:18.236689 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:18.243385 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:18.243856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:18.244285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:18.244959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:18.245404 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:18.245818 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:18.384044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:18.392627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2319f8f7-ee83-44b7-a965-fd601a44be04 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.160531 Sep 13 19:52:18.393250 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 113/222] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:18 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:18.656024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:18.656578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:18.663720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:18.664213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:18.664616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:18.665334 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:18.665778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:18.666190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:18.798607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:18.807445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e8005071-4a4b-4127-978b-e8084a240023 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.155385 Sep 13 19:52:18.808063 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 110/223] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:18 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:19.416190 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:19.416805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:19.423585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:19.424063 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:19.424488 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:19.425317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:19.425763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:19.426176 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:19.567504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:19.575721 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3227a87d-c6b0-46ca-b306-2c41f48dce90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.163737 Sep 13 19:52:19.576309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 114/224] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:19 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:19.833094 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:19.833094 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:19.838797 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:19.839285 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:19.839719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:19.840439 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:19.840906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:19.841442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:19.997979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:20.006154 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-41fa900b-3ee6-4457-86e9-0bf44d420237 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.178841 Sep 13 19:52:20.006904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 111/225] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:19 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:20.600471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:20.601082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:20.607965 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:20.608485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:20.608997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:20.609668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:20.610120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:20.610541 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:20.748771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:20.756854 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e2a6c284-dbd3-44d5-8f68-b3b17f48fed7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.160780 Sep 13 19:52:20.757452 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 115/226] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:20 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:21.034507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:21.036538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:21.045756 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:21.046584 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:21.047348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:21.048256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:21.049019 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:21.050183 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:21.203817 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:21.211880 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2c73647d-a635-4f81-aa2a-fe620dc6a138 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.185043 Sep 13 19:52:21.212680 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 112/227] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:21 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:21.780014 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:21.780585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:21.787551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:21.787655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:21.788085 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:21.788788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:21.789430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:21.789683 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:21.920575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:21.928747 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3dc8869b-5186-43d8-b7e0-9a401c8ff8ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.152851 Sep 13 19:52:21.929350 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 116/228] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:21 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:22.235705 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:22.236384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:22.243224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:22.243723 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:22.244147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:22.244858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:22.245325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:22.245748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:22.375766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:22.384345 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e0eeab7b-5718-4005-9705-4b80f0b2c988 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.152634 Sep 13 19:52:22.384919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 113/229] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:22 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:22.952303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:22.952902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:22.959206 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:22.959697 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:22.960120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:22.960811 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:22.961286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:22.961726 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:23.099921 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:23.108791 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-aaf5726d-f52d-498a-836c-6812623cea1a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.160597 Sep 13 19:52:23.109435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 117/230] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:22 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:23.413859 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:23.414464 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:23.421422 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:23.421898 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:23.422347 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:23.423034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:23.423476 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:23.424014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:23.570406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:23.578462 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1af49a4f-b5ec-4823-8eaa-1b50d4835ef1 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.168845 Sep 13 19:52:23.579046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 114/231] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:23 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:24.132205 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:24.133031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:24.139315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:24.139904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:24.140425 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:24.141214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:24.141878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:24.142214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:24.281919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:24.291050 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-74f9f6d6-471a-4109-b97b-166d269913af tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.163144 Sep 13 19:52:24.291840 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 118/232] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:24 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:24.603478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:24.604696 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:24.627436 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:24.627941 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:24.628780 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:24.629542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:24.630003 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:24.630449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:24.775911 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:24.785111 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d2e62e33-0f24-4900-9751-02e8f047be2c tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.186959 Sep 13 19:52:24.785688 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 115/233] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:24 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:25.303851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-e9163f9a-161f-431b-998e-f0ec8747ebcf req-1698c888-e363-4387-a20e-5d5798a715ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff13d54-7974-4ebf-80de-7b14e4eb473b", "name": "network-vif-plugged", "status": "completed", "tag": "d02aaf84-ef9f-498c-8f0a-bf8c4e34c571"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:25.315169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:25.316451 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:25.325189 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:25.329621 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:25.331139 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:25.334300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:25.336960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:25.337812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:25.338367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-e9163f9a-161f-431b-998e-f0ec8747ebcf req-1698c888-e363-4387-a20e-5d5798a715ce service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:25.343728 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-e9163f9a-161f-431b-998e-f0ec8747ebcf req-1698c888-e363-4387-a20e-5d5798a715ce service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:25.344491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-e9163f9a-161f-431b-998e-f0ec8747ebcf req-1698c888-e363-4387-a20e-5d5798a715ce service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:25.363744 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-e9163f9a-161f-431b-998e-f0ec8747ebcf req-1698c888-e363-4387-a20e-5d5798a715ce service nova] Creating event network-vif-plugged:d02aaf84-ef9f-498c-8f0a-bf8c4e34c571 for instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b on hv-cinder-82880 Sep 13 19:52:25.383091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-e9163f9a-161f-431b-998e-f0ec8747ebcf req-1698c888-e363-4387-a20e-5d5798a715ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084400 Sep 13 19:52:25.384970 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 119/234] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:25.534171 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:25.549255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-87c8b5c6-01bb-4451-b7dc-c18560dfa5f4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.238035 Sep 13 19:52:25.556935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 116/235] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:25 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:25.809286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:25.810303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:25.818259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:25.818988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:25.819620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:25.821121 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:25.821687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:25.822192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.024463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:26.033471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6b5bda14-afea-4ba8-ae14-9ffce8924b4d tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.228609 Sep 13 19:52:26.034074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 120/236] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:25 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:26.574180 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:26.574877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:26.582309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.582825 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.583274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.583989 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:26.584414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:26.585571 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:26.769485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:26.779906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a4c22254-66ab-4b39-8a6d-9bbb21374e1d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.209583 Sep 13 19:52:26.785953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 117/237] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:26 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:27.060803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:27.062341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:27.072106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.072762 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.073393 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.074115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.074574 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.074992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.235775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:27.245803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-213d9d2a-210f-40bf-8275-cdd1b347e5a4 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1314 microversion: 2.1 time: 0.189603 Sep 13 19:52:27.246405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 121/238] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:27 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:27.803551 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:27.808916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:27.818842 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.819613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.820579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.821387 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:27.821832 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:27.822251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:27.991332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:27.999287 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bcc65bad-5a46-4716-8421-2464cfa9bc48 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.200018 Sep 13 19:52:27.999826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 118/239] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:27 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:28.272503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:28.272503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:28.276338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.276828 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.277279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.277968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.278411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.278822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.427405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:28.435505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3c5ffead-fe28-41b6-91f0-5d2c8acdaa31 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1463 microversion: 2.1 time: 0.170521 Sep 13 19:52:28.436096 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 122/240] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:28 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:28.483935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:28.484420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:28.490520 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.490978 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.491401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.492093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.492535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.492970 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.524125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:52:28.661398 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-233038c8-3913-4bdd-b856-409a5c8952f9 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 204 len: 0 microversion: 2.1 time: 0.181928 Sep 13 19:52:28.662494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 119/241] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:52:28 2022] DELETE /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:52:28.671558 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:28.672928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:28.681047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.681810 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.682307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:28.683387 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:28.683909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:28.684397 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.026605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:29.029132 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:29.043158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.043848 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.044834 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.046235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:29.047019 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:29.047643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:29.086134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:29.095912 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-da4c49d1-dc67-4b8d-bb86-15d5fe7fbd4a tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1469 microversion: 2.1 time: 0.428688 Sep 13 19:52:29.115467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 123/242] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:28 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1469 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:29.231273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:29.254995 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4f3f95b5-d305-4fc8-a101-a771656394b8 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.235181 Sep 13 19:52:29.257645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 120/243] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:29 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:30.121873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:30.122557 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:30.129412 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.130022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.130474 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.131382 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.131844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.132360 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.281719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:30.283219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:30.296103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.297097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.297862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.299250 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:30.300472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:30.301509 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:30.347170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:30.365384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-cf8712be-89f9-43ee-8175-d11c6e365512 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1469 microversion: 2.1 time: 0.248096 Sep 13 19:52:30.366909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 124/244] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:30 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:30.578834 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:30.594885 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bf18ae94-5d1c-45ee-839c-c16b29038bd0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.318457 Sep 13 19:52:30.595590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 121/245] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:30 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:31.394514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:31.395227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:31.402866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:31.403354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:31.403940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.404651 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:31.405132 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:31.405548 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.566813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:31.575671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:31.578358 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1ffa76d7-89cf-49e2-af83-8f8793be4573 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1469 microversion: 2.1 time: 0.189374 Sep 13 19:52:31.578952 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 125/246] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:31 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:31.621901 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:31.630480 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:31.646898 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:31.647505 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:31.648307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.649213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:31.657067 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:31.658273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:31.703605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:31.899170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:31.907448 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a33b5e8c-ccff-4c64-866e-8881e9354048 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.290419 Sep 13 19:52:31.908137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 122/247] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:31 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:32.329975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-883524326", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "networks": [{"uuid": "e6a79854-63f4-40b5-99e7-83725bff6789"}]}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:32.386641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] validate_networks() for [('e6a79854-63f4-40b5-99e7-83725bff6789', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:52:32.606506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:32.607281 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:32.614521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.614916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.615347 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.616118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:32.616556 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:32.617027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:32.979691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:33.006673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f5c8422f-13b7-47a9-92ed-a0a8cc32add2 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1469 microversion: 2.1 time: 0.401829 Sep 13 19:52:33.008259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 123/248] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:32 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1469 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:33.016532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:33.017994 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:33.031874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.032658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.033436 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.034668 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.035634 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.036301 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.255476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:52:33.258880 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:52:33.260088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:52:33.261359 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:52:33.270048 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:52:33.281679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.282364 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.283037 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.284049 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.284541 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.285207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.307283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Getting quotas for project fa70232219304082b5ee608a7ea61c22. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:33.311571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Getting quotas for user 11c76c57183e406c87f434841fc13b43 and project fa70232219304082b5ee608a7ea61c22. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:33.324827 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:52:33.327437 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:52:33.332199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:33.341384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ffa16d2b-dae8-480f-a6f1-bc505880456b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.331749 Sep 13 19:52:33.342017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 124/249] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:33 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:33.347422 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:33.348126 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:33.355109 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.355109 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.355533 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.356478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.356980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.357573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.383803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-902aab8b-108b-4540-b54a-98bf32877e9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/ips" status: 200 len: 151 microversion: 2.20 time: 0.040707 Sep 13 19:52:33.384402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 125/250] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Sep 13 19:52:33 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:52:33.389444 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-10a0c6d9-8527-4aa6-a257-bde52add845e req-d04aa7fe-bf50-4474-b031-afefbb5d095f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff13d54-7974-4ebf-80de-7b14e4eb473b", "name": "network-vif-deleted", "tag": "d02aaf84-ef9f-498c-8f0a-bf8c4e34c571"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:33.401456 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-10a0c6d9-8527-4aa6-a257-bde52add845e req-d04aa7fe-bf50-4474-b031-afefbb5d095f service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:33.402164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-10a0c6d9-8527-4aa6-a257-bde52add845e req-d04aa7fe-bf50-4474-b031-afefbb5d095f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:33.403160 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-10a0c6d9-8527-4aa6-a257-bde52add845e req-d04aa7fe-bf50-4474-b031-afefbb5d095f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:33.410187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6fda0d99-7486-4ea6-8af9-f5055f1f1989 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084103 Sep 13 19:52:33.412118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 126/251] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:52:33.417151 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-10a0c6d9-8527-4aa6-a257-bde52add845e req-d04aa7fe-bf50-4474-b031-afefbb5d095f service nova] Creating event network-vif-deleted:d02aaf84-ef9f-498c-8f0a-bf8c4e34c571 for instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b on hv-cinder-82880 Sep 13 19:52:33.423082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-10a0c6d9-8527-4aa6-a257-bde52add845e req-d04aa7fe-bf50-4474-b031-afefbb5d095f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037119 Sep 13 19:52:33.423915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cd232a16-059e-4d36-9f7f-06fb2f2b016f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:33.424236 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 126/252] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:33.425725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cd232a16-059e-4d36-9f7f-06fb2f2b016f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:33.489774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-cd232a16-059e-4d36-9f7f-06fb2f2b016f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:33.496993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-cd232a16-059e-4d36-9f7f-06fb2f2b016f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1218 microversion: 2.1 time: 0.077880 Sep 13 19:52:33.497945 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 127/253] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:33 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:34.035529 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.036262 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.043815 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.044269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.044687 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.045430 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.045878 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.046298 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.081679 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.082160 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.082585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.083029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lazy-loading 'fault' on Instance uuid 2ff13d54-7974-4ebf-80de-7b14e4eb473b {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:34.134659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '299a8c2de0cf4f0aa1570c718fe04e52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ad20021ed0483186dad6591ba5ce67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:34.143966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7537d7fb-1b08-4324-ace9-16e0310df7d0 tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 200 len: 1304 microversion: 2.1 time: 0.112991 Sep 13 19:52:34.144571 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 127/254] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:34 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:34.366454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.367299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.376362 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.376944 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.377456 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.378421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.379021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.379487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.522141 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.523120 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.529177 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.529662 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.530087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.530789 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.531235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.531651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.534501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:34.543515 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a7ce359f-cd79-4776-a0ce-71bdd4459e44 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1502 microversion: 2.1 time: 0.181577 Sep 13 19:52:34.544089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 128/255] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:34 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:34.570665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec0214ab-5fe5-4ec2-a387-d1f405d338e8"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:34.577172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.584339 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.584818 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.585441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.586170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.586779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.587187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.614275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] HTTP exception thrown: Cannot 'attach_volume' instance f4427ca0-6d69-4863-9b14-6b456b1bde67 while it is in vm_state rescued Sep 13 19:52:34.614678 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Request method failure captured: Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: POST /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67/os-volume_attachments HTTP/1.1 Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 74 Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN8IWZVJgTK_kjohabZObSZmELvZaDYYGCq3h-A34bxLqZoZkgP85o1Gt98TSagy5HnN8qGNGzQn_eURe1G2bJBqGGcHCeIqeO8bSFjNXLsHvrDf5ud3D2UAtAUx88bIL6KX0KOrwThqmAurXBcKPff8h0V10QBkuMp21KERvcQ5k-4 Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:52:34.616271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_592bbccef3ef42ccbc7e2c3dc5bb86de", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}] Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: a1c9d4af0a98406692e1d79293844c68 Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {"volumeAttachment": {"volumeId": "ec0214ab-5fe5-4ec2-a387-d1f405d338e8"}} Sep 13 19:52:34.617763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Cannot 'attach_volume' instance f4427ca0-6d69-4863-9b14-6b456b1bde67 while it is in vm_state rescued Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'server_id': 'f4427ca0-6d69-4863-9b14-6b456b1bde67', 'body': {'volumeAttachment': {'volumeId': 'ec0214ab-5fe5-4ec2-a387-d1f405d338e8'}}} Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4427ca0-6d69-4863-9b14-6b456b1bde67 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:52:34.618550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f4427ca0-6d69-4863-9b14-6b456b1bde67 while it is in vm_state rescued Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:34.622290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:34.623445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:52:34.623445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:52:34.623445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f4427ca0-6d69-4863-9b14-6b456b1bde67 while it is in vm_state rescued Sep 13 19:52:34.623445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:34.623445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Returning 409 to user: Cannot 'attach_volume' instance f4427ca0-6d69-4863-9b14-6b456b1bde67 while it is in vm_state rescued {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:52:34.623445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-31c338e9-b5fb-41eb-ae84-e1dea043809b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054106 Sep 13 19:52:34.623445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 129/256] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:52:34 2022] POST /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 19:52:34.628161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8c2994f7-0f2a-4d34-b3b4-6f248e92f674 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1214 microversion: 2.1 time: 0.111789 Sep 13 19:52:34.628426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 128/257] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:34 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1214 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:34.635898 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:34.636422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.643897 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.644575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.645307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.646109 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.646567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.647066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.763000 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a2ed8c0d-0890-4a3b-a84c-669d77a98160 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67/action" status: 202 len: 0 microversion: 2.1 time: 0.133022 Sep 13 19:52:34.764112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 130/258] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:52:34 2022] POST /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:52:34.776590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:34.777325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:34.783580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.784269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.784789 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.785650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:34.786105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:34.786558 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:34.925344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:34.933362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c019044d-56df-478b-ad2a-c4020149c08d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.160878 Sep 13 19:52:34.933937 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 129/259] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:34 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:35.169175 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:35.169874 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] [instance: 2ff13d54-7974-4ebf-80de-7b14e4eb473b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:35.176756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.177271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.177703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.178402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.178851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.179274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.192995 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] HTTP exception thrown: Instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b could not be found. Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Request method failure captured: Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b HTTP/1.1 Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN9Pxx_hHgpHNm6P3SGpy_y6NJuAyCZKMASuQfLNfmXsaSPvBsNg_s4LdFH8zhwKRPCyDh4k4Ymt5Eq2ZPXLKaRcoBuxdic-dHeHoVREI4S4gF6KqyutLlZRg2PHI4rRmKFOMGTb09ri4jvOTBO000WuLIXX_j3FtmBWAjYn6-exnP8 Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 62ad20021ed0483186dad6591ba5ce67 Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesNegativeTest-2012032774 Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:52:35.194611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62ad20021ed0483186dad6591ba5ce67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_62ad20021ed0483186dad6591ba5ce67", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/62ad20021ed0483186dad6591ba5ce67"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/62ad20021ed0483186dad6591ba5ce67"}]}] Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesNegativeTest-2012032774 Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 62ad20021ed0483186dad6591ba5ce67 Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesNegativeTest-2012032774 Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesNegativeTest-2012032774-project Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 299a8c2de0cf4f0aa1570c718fe04e52 Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesNegativeTest-2012032774-project Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b could not be found. Sep 13 19:52:35.196062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '2ff13d54-7974-4ebf-80de-7b14e4eb473b'} Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b could not be found. Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:52:35.196903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b could not be found. Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b could not be found. Sep 13 19:52:35.198228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:52:35.199442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] Returning 404 to user: Instance 2ff13d54-7974-4ebf-80de-7b14e4eb473b could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:52:35.199442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-48df82c8-f9c1-467d-a3af-4b76fc7fa5bb tempest-VolumesNegativeTest-2012032774 tempest-VolumesNegativeTest-2012032774-project] 10.222.0.18 "GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b" status: 404 len: 111 microversion: 2.1 time: 0.031218 Sep 13 19:52:35.199442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 131/260] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:35 2022] GET /compute/v2.1/servers/2ff13d54-7974-4ebf-80de-7b14e4eb473b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:52:35.651627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:35.652313 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:35.659528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.659989 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.660425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.661513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.662275 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.662734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.730494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:35.741372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b3b3a214-6e75-4993-a44c-d07dce651600 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1270 microversion: 2.1 time: 0.093521 Sep 13 19:52:35.741953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 130/261] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:35 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:35.956658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:35.957297 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:35.963545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.964019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.964443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:35.965242 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:35.965773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:35.966086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.111372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:36.120134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7c6ba254-0eaa-468e-b41b-a10a3c74a193 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.167360 Sep 13 19:52:36.120805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 132/262] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:35 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:36.764256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:36.764700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:36.773270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.773826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.774407 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.775168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:36.775619 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:36.775963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:36.845603 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:36.857833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-00c333be-702a-4719-b59c-663de6f519f7 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1270 microversion: 2.1 time: 0.097813 Sep 13 19:52:36.858571 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 131/263] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:36 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:37.143796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:37.144596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:37.152630 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.153212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.153658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.154400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.154851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.155274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.295819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:37.303882 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ed3c64be-c884-40f5-b822-16e4bb9ca74e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.164063 Sep 13 19:52:37.304454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 133/264] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:37 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:37.881099 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:37.881716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:37.888400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.888875 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.889329 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.890009 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:37.890467 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:37.890883 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:37.959930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:37.967953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8bb57ab4-ae36-47ac-9a11-d943b2c4510e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1270 microversion: 2.1 time: 0.091019 Sep 13 19:52:37.968521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 132/265] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:37 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:38.327620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:38.328214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:38.334902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.335413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.335847 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.336538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.337017 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.337434 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.362685 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:38.363119 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:38.369712 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.370208 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.370638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.371332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.371772 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.372188 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.398507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lazy-loading 'flavor' on Instance uuid 9fc2f361-c297-4a69-9898-d4d3cc310118 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:52:38.473277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:38.481235 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d42f9840-476e-4ef4-95fb-796464357f51 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.157506 Sep 13 19:52:38.482021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 134/266] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:38 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:38.549931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:38.550422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:38.556837 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.557367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.557817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.558528 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.558963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.559382 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.589776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b0d3924d-d0b8-42de-b639-7052761b5798 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/ips" status: 200 len: 145 microversion: 2.1 time: 0.043827 Sep 13 19:52:38.590684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 135/267] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 19:52:38 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:52:38.606137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8e85a733-808e-4892-b5a1-c22d5ff74697 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/action" status: 202 len: 0 microversion: 2.20 time: 0.247445 Sep 13 19:52:38.606747 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 133/268] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 19:52:38 2022] POST /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:52:38.615378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:38.616065 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:38.622188 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.622675 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.623106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.623798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:38.624246 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:38.624666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:38.761043 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:38.769240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:38.771298 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:38.772476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1fff4ae9-2a3b-4211-a659-07b801a91d29 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.161289 Sep 13 19:52:38.773072 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 136/269] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:38 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:38.992613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:38.994110 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:39.004039 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.004749 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.005523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.006493 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.007144 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.007708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.080657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.089232 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-449a3eb9-0b55-4718-a8a8-77f98f8e4e51 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1270 microversion: 2.1 time: 0.101887 Sep 13 19:52:39.089951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 134/270] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:38 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:39.506832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:39.507390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:39.509367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:39.515196 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.515682 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.516124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.516825 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.517304 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.517717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.691263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.699785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d5de33b6-29de-4005-9352-76ef569445ff tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.197475 Sep 13 19:52:39.700374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 137/271] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:39 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:39.801417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:39.802038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:39.808824 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.809223 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.809657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.810511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:39.810960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:39.811380 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:39.964254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.973482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.974742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:39.975920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-22c1de95-0aec-4934-a8a8-d96b7f0c0f74 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.179888 Sep 13 19:52:39.976513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 135/272] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:39 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:40.112967 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:40.113602 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:40.120740 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.121255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.121850 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.122558 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.123001 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.123593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.188772 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:40.197978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-420407d6-3801-46a7-8b5c-ca86b401c64f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1270 microversion: 2.1 time: 0.089019 Sep 13 19:52:40.198668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 138/273] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:40 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:40.723487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:40.724056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:40.730980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.731471 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.731898 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.732629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:40.733135 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:40.733821 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:40.940763 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:40.951837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b669b10b-24b1-4cf8-934b-a1b1b4819f9b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.231843 Sep 13 19:52:40.953074 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 136/274] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:40 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:41.010078 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:41.011462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:41.019411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.020191 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.020839 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.022294 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.022961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.023748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.200593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:41.209746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:41.211518 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:41.212753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2826cccf-0e97-44d2-9c2c-f1b84232a9e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.214955 Sep 13 19:52:41.233758 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 139/275] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:40 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:41.240142 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:41.241320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:41.261793 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.262767 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.264834 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.266151 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.269210 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.269977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.367534 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:41.371833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:41.388376 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d82d2d83-1055-4dd6-a15f-afd1fc9f6755 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1276 microversion: 2.1 time: 0.152104 Sep 13 19:52:41.405237 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 137/276] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:41 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:41.977489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:41.978259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:41.985963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.986524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.986903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:41.987671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:41.988291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:41.988875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.130750 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:42.138861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-341fc564-d588-4aca-b907-b376ee761e53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.166698 Sep 13 19:52:42.139509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 140/277] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:41 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:42.255427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:42.256038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:42.269511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.269824 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.270447 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.271322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.273166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.273905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.412772 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:42.413483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:42.422708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:42.423231 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.423699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.424127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.425079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.425538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.425956 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.431537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:42.434534 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:42.436765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-46f91360-4d4c-4dec-9f1a-ebe66e766a70 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.197629 Sep 13 19:52:42.440104 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 138/278] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:42 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:42.494653 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-8caa25b6-c246-489a-a2a5-9f7aa1ba0159 req-31f385ca-70ea-486d-8bd5-1159c6fbb314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d98e739-aa2a-4dff-971d-c5afbe05f847", "tag": "25661ba9-640d-477f-829b-4a3601204167"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:42.505608 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-8caa25b6-c246-489a-a2a5-9f7aa1ba0159 req-31f385ca-70ea-486d-8bd5-1159c6fbb314 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.506083 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-8caa25b6-c246-489a-a2a5-9f7aa1ba0159 req-31f385ca-70ea-486d-8bd5-1159c6fbb314 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.506503 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-8caa25b6-c246-489a-a2a5-9f7aa1ba0159 req-31f385ca-70ea-486d-8bd5-1159c6fbb314 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.530654 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-8caa25b6-c246-489a-a2a5-9f7aa1ba0159 req-31f385ca-70ea-486d-8bd5-1159c6fbb314 service nova] Creating event network-changed:25661ba9-640d-477f-829b-4a3601204167 for instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 on hv-cinder-82880 Sep 13 19:52:42.538393 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-8caa25b6-c246-489a-a2a5-9f7aa1ba0159 req-31f385ca-70ea-486d-8bd5-1159c6fbb314 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047257 Sep 13 19:52:42.539532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 139/279] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:42.619207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:42.627338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ab4926bc-6b5a-4518-9a28-fa89646e9230 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.219387 Sep 13 19:52:42.628086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 141/280] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:42 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:42.771998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7cae326-3375-45b8-985e-78cd03bc39d4"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:42.778785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:42.792929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.793440 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.794219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:42.797866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:42.798388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:42.798820 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.164281 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:43.165180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:43.171789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.172467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.172971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.173890 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.174573 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.175003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.296220 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:43.420677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.428735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-40f1733d-7774-47ea-a661-78453fa207b4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1510 microversion: 2.1 time: 0.269196 Sep 13 19:52:43.445409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 142/281] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:43 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:43.466409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:43.467061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:43.473573 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.474369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.475018 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.475960 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.476625 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.477285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.496220 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=8 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:43.519273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3c5013e9-1e64-4f7d-9cf1-0b338c07e8a3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.757076 Sep 13 19:52:43.527580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 140/282] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:52:42 2022] POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:43.651204 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:43.652331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:43.659818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.660403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.660985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.662176 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:43.662858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:43.663633 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:43.747452 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.759006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.761118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.762774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d0c666de-17ee-47a1-8245-3fcbe9e24f04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.300508 Sep 13 19:52:43.774265 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 143/283] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:43 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:43.894039 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:43.910095 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c9c2e807-1116-4ab8-b6e5-3195f505b28e tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.263401 Sep 13 19:52:43.910704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 141/284] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:43 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:44.454476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:44.455148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:44.461419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.461880 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.462310 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.463035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.463496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.463923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.479305 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:44.635104 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:44.644270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-13a23179-528a-4034-9258-bdb4a4641549 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1516 microversion: 2.1 time: 0.193676 Sep 13 19:52:44.673150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 144/285] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:44 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:44.789617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:44.791398 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:44.798846 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.800362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.801189 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.802550 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.803325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.804018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.944665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:44.946342 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:44.957643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.959465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.959924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.960693 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:44.961335 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:44.961910 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:44.986659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:45.000191 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:45.006561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:45.008554 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b548827a-3902-47e2-ac02-806d8484b398 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.223454 Sep 13 19:52:45.010392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 142/286] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:44 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:45.157362 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:45.167242 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3a373626-f6ed-4693-b9fd-7470bd548b71 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.229593 Sep 13 19:52:45.168069 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 145/287] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:44 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:46.039127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:46.039759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:46.042423 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:46.047996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.048854 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.049515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.050337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.050834 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.051286 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.129120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-750a73dd-924f-4fc6-9d60-e9336d151070 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'create', calling method: .version_select at 0x7f98b6c06700>, body: {"keypair": {"name": "tempest-keypair-1387464593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeVTrOriwnLQ5M/RTPMaiQivR3Jz1ZDNc20hl6/HTPdxlFE62897QGAbhoateRxufHsiPXP6AT0oowTYcNRT8TvLnpnoH9oJ6v3iotBHdbAXG20a91UGbRodxvEXC3r7Q=="}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:46.155701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-750a73dd-924f-4fc6-9d60-e9336d151070 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:46.161151 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-750a73dd-924f-4fc6-9d60-e9336d151070 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for user a1c9d4af0a98406692e1d79293844c68 and project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:46.197668 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:46.208928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-750a73dd-924f-4fc6-9d60-e9336d151070 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083709 Sep 13 19:52:46.209724 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:46.212681 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:46.214475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a2bc4121-5025-41d8-9236-85251b2dea10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.179715 Sep 13 19:52:46.215141 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 143/288] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:46 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:46.221079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 146/289] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:52:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:46.221744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:46.222902 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:46.230734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.232054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.232729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.233534 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:46.234708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:46.235135 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:46.446904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:46.457535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-291f8352-c8d3-4646-82df-a7684ff932e4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.240974 Sep 13 19:52:46.458247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 144/290] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:46 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:47.241031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:47.242395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:47.249757 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.249988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.250510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.251729 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.252490 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.253103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.480059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:47.480636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:47.484622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:47.488481 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.489267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.489701 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.490407 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:47.490860 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:47.491331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:47.493909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:47.495349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:47.496907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-96ee81b2-7449-4e2f-8bb4-8410fdc4e620 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.260948 Sep 13 19:52:47.497491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 147/291] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:47 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:47.713935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:47.724375 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-761fc3b8-84e2-41f7-bda6-5f1cb07f87ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.248106 Sep 13 19:52:47.725755 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 145/292] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:47 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:48.213121 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-738615978", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ad795ab-6f5d-44be-b923-ac7221123b91"}], "security_groups": [{"name": "tempest-securitygroup--1368956440"}], "key_name": "tempest-keypair-1387464593", "user_data": "}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:48.330972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] validate_networks() for [('5ad795ab-6f5d-44be-b923-ac7221123b91', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:52:48.523533 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:48.524119 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:48.535555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:48.536197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:48.537152 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:48.537980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:48.538516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:48.539929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:48.921430 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:48.933519 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:48.934951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:48.936123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5d0c7a0e-2b57-49c5-b808-59cb232bafdb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.416645 Sep 13 19:52:48.936762 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 146/293] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:48 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:48.944402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:48.945276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:48.953420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:48.954555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:48.955222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:48.956524 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:48.957326 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:48.957962 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.134420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:52:49.135041 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:52:49.135505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:52:49.135936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:52:49.136317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:52:49.145950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.146462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.147019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.147905 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.148352 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.148766 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.173872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:52:49.178897 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Getting quotas for user a1c9d4af0a98406692e1d79293844c68 and project 592bbccef3ef42ccbc7e2c3dc5bb86de. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:52:49.191954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:52:49.194529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:52:49.209137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:49.217539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e8ef74a9-9af6-4e61-b192-ba824a47099c tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.279403 Sep 13 19:52:49.218354 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 147/294] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:48 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:49.261127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-cb3aa4fb-6700-4ef4-8a96-b3d5aecffad6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.043693 Sep 13 19:52:49.261127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 148/295] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:52:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:52:49.264620 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-351941a8-dac2-47a3-8d37-82e608468afa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:49.265255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-351941a8-dac2-47a3-8d37-82e608468afa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:49.335420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-351941a8-dac2-47a3-8d37-82e608468afa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:49.342659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-351941a8-dac2-47a3-8d37-82e608468afa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1245 microversion: 2.1 time: 0.082315 Sep 13 19:52:49.343241 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 148/296] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:49 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:49.745877 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-3d80305f-2188-422b-a51e-4e06d49945ec req-b486f774-6080-4fa6-a69c-c18c8b1c9fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d98e739-aa2a-4dff-971d-c5afbe05f847", "name": "network-vif-plugged", "status": "completed", "tag": "25661ba9-640d-477f-829b-4a3601204167"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:49.771940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3d80305f-2188-422b-a51e-4e06d49945ec req-b486f774-6080-4fa6-a69c-c18c8b1c9fc4 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.772684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3d80305f-2188-422b-a51e-4e06d49945ec req-b486f774-6080-4fa6-a69c-c18c8b1c9fc4 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.773690 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3d80305f-2188-422b-a51e-4e06d49945ec req-b486f774-6080-4fa6-a69c-c18c8b1c9fc4 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.796623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-3d80305f-2188-422b-a51e-4e06d49945ec req-b486f774-6080-4fa6-a69c-c18c8b1c9fc4 service nova] Creating event network-vif-plugged:25661ba9-640d-477f-829b-4a3601204167 for instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 on hv-cinder-82880 Sep 13 19:52:49.810855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-3d80305f-2188-422b-a51e-4e06d49945ec req-b486f774-6080-4fa6-a69c-c18c8b1c9fc4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071240 Sep 13 19:52:49.811810 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 149/297] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:49.962241 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:49.963059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:49.971378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.971884 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.972316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:49.973060 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:49.973527 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:49.973920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:50.169743 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:50.178353 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:50.179785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:50.181018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2347fb79-5930-4e8d-8fa2-03913445359a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.222910 Sep 13 19:52:50.181582 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 149/298] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:49 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:50.240545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:50.241264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:50.247627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:50.248075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:50.248494 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:50.249201 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:50.249646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:50.250055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:50.365798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:50.366441 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:50.372874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:50.373386 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:50.373819 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:50.374535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:50.374982 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:50.375400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:50.386859 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:50.394920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-27eaa6f0-7f19-4289-a377-ff061277e0d6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.158747 Sep 13 19:52:50.395501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 150/299] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:50 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:50.444314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:50.454426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a69dcfcb-856b-4e6c-8fd5-bb73ed0531a7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1297 microversion: 2.1 time: 0.092619 Sep 13 19:52:50.455034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 150/300] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:50 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:51.207232 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:51.207865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:51.214172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.214869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.215325 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:51.216054 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.216504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.216950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:51.356260 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:51.364691 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:51.366176 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:51.367358 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-30c0f187-80f6-4e38-b17a-f35fd9d68fbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.164196 Sep 13 19:52:51.367926 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 151/301] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:51 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:51.418722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:51.419320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:51.426310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.426788 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.427220 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:51.427927 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.428372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.428785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:51.478067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:51.478710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:51.485384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.485870 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.486293 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:51.488204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:51.488204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:51.488204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:51.564859 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:51.573265 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f9e147bb-8a19-4193-9b22-01e3eb720e0c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1297 microversion: 2.1 time: 0.099036 Sep 13 19:52:51.573864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 152/302] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:51 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:51.598876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:51.607383 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-78324e0d-9b72-44a8-93b8-154d00bf1a9f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1318 microversion: 2.1 time: 0.192700 Sep 13 19:52:51.608164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 151/303] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:51 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:52.394441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:52.394996 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:52.401130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:52.401698 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:52.402175 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.402870 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:52.403503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:52.403919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.549926 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:52.558864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:52.560291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:52.561658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1561dd3c-ef39-4893-80ab-ba0741b76f63 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.171484 Sep 13 19:52:52.562331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 153/304] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:52 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:52.596072 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:52.596761 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:52.603466 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:52.603942 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:52.604368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.605099 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:52.605547 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:52.605959 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.632477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:52.632477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:52.639030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:52.639516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:52.639927 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.640605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:52.641138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:52.641616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:52.673798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:52.684912 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-33e97e2f-b2f2-4894-93d7-062c97a31125 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1305 microversion: 2.1 time: 0.092612 Sep 13 19:52:52.696918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 152/305] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:52 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:52.784993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:52.794848 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2a1b680f-14b4-432e-8f58-45bcf90296ef tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1507 microversion: 2.1 time: 0.168232 Sep 13 19:52:52.795556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 154/306] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:52 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:53.452913 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-36b2c807-3ca8-434a-a83f-f1b329df6db4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:53.459756 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-36b2c807-3ca8-434a-a83f-f1b329df6db4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.460236 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-36b2c807-3ca8-434a-a83f-f1b329df6db4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.460872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-36b2c807-3ca8-434a-a83f-f1b329df6db4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.535836 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-36b2c807-3ca8-434a-a83f-f1b329df6db4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Going to try to stop instance {{(pid=132127) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 19:52:53.583061 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:53.590487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:53.591258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:53.603232 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.604035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.605525 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.606719 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.607407 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.608276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.619627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-36b2c807-3ca8-434a-a83f-f1b329df6db4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action" status: 202 len: 0 microversion: 2.1 time: 0.169650 Sep 13 19:52:53.622135 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 153/307] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:52:53 2022] POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:52:53.660012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:53.660913 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:53.679843 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.681682 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.682598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.683504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.684119 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.684697 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.823650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:53.838669 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:53.840517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:53.842213 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8f418dc9-1608-4b9a-b906-5d5618b6e2ae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.256771 Sep 13 19:52:53.843031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 155/308] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:53 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:53.871604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:53.873828 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:53.881565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:53.885984 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.887614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.888790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.889961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:53.890088 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c6781c49-8f8e-475c-8d11-85f97c59d4d6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.253150 Sep 13 19:52:53.890556 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 154/309] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:53 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:53.905047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:53.905047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:53.980548 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:53.994400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-95bb1536-accf-4da0-92f3-567f018045f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1303 microversion: 2.1 time: 0.139146 Sep 13 19:52:53.995282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 156/310] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:53 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:54.871700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:54.872289 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:54.879496 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:54.880303 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:54.881034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:54.882042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:54.882717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:54.883343 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:54.915825 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:54.916472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:54.923568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:54.924603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:54.925288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:54.926976 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:54.927708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:54.928345 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.125845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:55.137974 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:55.140579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:55.142538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e2248470-30cb-4910-bda2-544a1752df08 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.274778 Sep 13 19:52:55.145553 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:55.157183 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-233065a1-c23a-489d-88a1-cb53dc62dab2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.244642 Sep 13 19:52:55.157183 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 157/311] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:54 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:55.157676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 155/312] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:54 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:55.166549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-7864eb39-6479-4e57-9637-2e25857a0fa2 req-a1b55b19-c230-4162-935d-a02af41ae094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b1b8b5-f84c-4ba9-9bf9-75535a05af91", "tag": "b09f2e8a-de1a-4977-93b0-5ea0ae7926e1"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:52:55.176749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:55.177389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:55.177738 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7864eb39-6479-4e57-9637-2e25857a0fa2 req-a1b55b19-c230-4162-935d-a02af41ae094 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.178292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7864eb39-6479-4e57-9637-2e25857a0fa2 req-a1b55b19-c230-4162-935d-a02af41ae094 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.178807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7864eb39-6479-4e57-9637-2e25857a0fa2 req-a1b55b19-c230-4162-935d-a02af41ae094 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.186277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.186780 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.187209 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.187906 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:55.188336 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:55.189043 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:55.191181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-7864eb39-6479-4e57-9637-2e25857a0fa2 req-a1b55b19-c230-4162-935d-a02af41ae094 service nova] Creating event network-changed:b09f2e8a-de1a-4977-93b0-5ea0ae7926e1 for instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 on hv-cinder-82880 Sep 13 19:52:55.197588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-7864eb39-6479-4e57-9637-2e25857a0fa2 req-a1b55b19-c230-4162-935d-a02af41ae094 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038824 Sep 13 19:52:55.198200 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 156/313] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:52:55.349525 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:55.357712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-bba1c1ba-466a-459e-bdac-3136dfae146f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.191235 Sep 13 19:52:55.358316 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 158/314] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:55 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:56.171819 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:56.173269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:56.180298 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:56.181302 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.181727 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:56.181870 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.182194 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.183082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.183520 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.183939 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.187848 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.188550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.189155 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.189851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.190290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.190966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.390531 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:56.395153 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:56.403409 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:56.404623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-910ec6c0-2962-4d8b-8260-57c98d3a34c2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.228748 Sep 13 19:52:56.405094 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:56.405250 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 159/315] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:56 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:52:56.406384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dc264bfd-72f6-4913-bc84-4a503639daae tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.238859 Sep 13 19:52:56.421260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 157/316] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:56 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:52:56.421834 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:56.423021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:56.429221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.429699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.430127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.430806 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:56.431243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:56.431706 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:56.581156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:56.593886 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6604581d-4dfb-4eb9-a069-0b2d95dc7db0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.186946 Sep 13 19:52:56.594521 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 160/317] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:56 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:57.429998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:57.430595 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:57.431578 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:57.432181 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:57.437490 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.437989 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.438391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.438546 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.439128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.439249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.439579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.439955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.440104 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.441598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.441598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.441598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.659318 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:57.669421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-56b96b7a-82fe-446f-8deb-d79ecdb030ed tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.243082 Sep 13 19:52:57.682036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 158/318] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:57 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:57.699788 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:57.699788 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:57.700253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.701000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.701465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.702401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:57.702826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:57.703254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:57.704269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:57.719308 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:57.721109 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:57.723716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d5ac94e2-260b-4cf4-a508-9993362d2259 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.296089 Sep 13 19:52:57.725125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 161/319] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:57 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:57.864623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:57.874846 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3bdb7aa1-12bc-45d1-bd31-5ba0e21e29f0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.190845 Sep 13 19:52:57.875882 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 159/320] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:57 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:58.698988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:58.699565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:58.706295 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.706817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.707251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.707924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.708412 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.708842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.760655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:58.760655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:58.760655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.760655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.761856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.761856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.761856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.761856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.903808 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:58.913647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fabba81a-d076-4573-8995-c7f02bc135cf tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.218476 Sep 13 19:52:58.914571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 162/321] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:58 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:58.919715 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:58.920495 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:58.927567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.928432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.929153 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.930113 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:58.930551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:58.931159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:58.941623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:58.947916 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:58.950304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:58.951819 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:58.953421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-afefa93f-b6d4-4198-8dba-d88d69e90535 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1745 microversion: 2.20 time: 0.206985 Sep 13 19:52:58.953969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 160/322] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:58 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1745 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:52:59.075274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:52:59.083341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ab40a50c-e01b-4d0d-909a-2421af4f201b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.167457 Sep 13 19:52:59.083919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 163/323] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:58 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:52:59.938675 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:59.939238 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:59.941905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:59.948138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:59.948618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:59.949080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:59.949800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:59.950243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:59.950655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:59.979730 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:52:59.980371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:52:59.982359 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:59.983055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=10 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:52:59.990619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:59.991104 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:59.991522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:52:59.992210 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:52:59.992695 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:52:59.993164 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:00.148353 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:00.157043 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7acf37a3-a794-46a4-afa3-f8f970695a8b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.223211 Sep 13 19:53:00.157631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 161/324] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:52:59 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:00.162568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:00.163170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:00.169554 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:00.170052 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:00.170504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:00.171224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:00.171739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:00.172088 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:00.175282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:00.186152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:00.187589 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:00.188841 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-82976b18-64f7-4aae-8b1f-87df9c8b4d4c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1745 microversion: 2.20 time: 0.213011 Sep 13 19:53:00.189377 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 164/325] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:52:59 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1745 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:00.315155 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:00.323147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c121f156-18a9-4a7f-8f5b-a0fd6cab77c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.164518 Sep 13 19:53:00.323704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 162/326] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:00 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:01.181774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:01.182345 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:01.188770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.189303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.189727 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.190496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.190959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.191378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.213907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:01.214503 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:01.221392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.221876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.222304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.222993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.223643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.224244 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.407795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:01.416921 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e99a5282-74f8-4fac-86dc-2b614e45883e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.239002 Sep 13 19:53:01.417538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 165/327] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:01 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:01.422366 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:01.423014 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:01.423469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:01.430307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.431102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.431550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.432616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:01.433111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:01.433532 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:01.434867 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:01.436301 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:01.437539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-029cfd24-42f8-4b73-8b6c-209b99d58685 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1745 microversion: 2.20 time: 0.227734 Sep 13 19:53:01.438096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 163/328] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:01 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1745 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:01.579467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:01.588046 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c49e5c3d-116c-47aa-bfaf-1bd7738c4f3b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.169391 Sep 13 19:53:01.588983 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 166/329] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:01 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:02.442718 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:02.443351 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:02.450390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.450888 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.451311 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.452032 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.452480 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.452927 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.464696 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:02.465375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:02.472097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.472603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.473076 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.473804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.474242 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.474656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.663495 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:02.670885 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:02.674241 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1f6a417f-cca7-4216-b249-4ca960931fd6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.235299 Sep 13 19:53:02.680807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:02.681265 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 164/330] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:02 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:02.683109 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:02.684990 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-aac6278f-fcb4-418b-8ffb-77aa12f14503 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1745 microversion: 2.20 time: 0.224849 Sep 13 19:53:02.686144 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 167/331] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:02 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1745 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:02.688472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:02.689268 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:02.696722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.697865 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.698531 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.699510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:02.700184 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:02.700818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:02.841958 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:02.849997 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ec7eca43-bd69-42b8-87cf-8808f992e897 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.166940 Sep 13 19:53:02.850600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 165/332] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:02 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:03.704302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:03.705009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:03.713753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:03.714480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:03.714919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:03.715637 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:03.715895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:03.716374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:03.716482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:03.716574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:03.723514 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:03.723897 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:03.724324 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:03.725301 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:03.725662 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:03.726276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:03.952607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:03.961942 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:03.963471 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:03.964591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4a0c0a4c-f49c-4e39-a22c-92d3225b7dac tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.253887 Sep 13 19:53:03.985617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 166/333] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:03 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:03.986333 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:03.997555 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-771363f2-7fdb-4900-a49e-b15afa37467f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.296871 Sep 13 19:53:03.998158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 168/334] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:03 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:04.003402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:04.004306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:04.013178 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:04.013667 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:04.014096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:04.014792 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:04.015240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:04.015835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:04.192294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:04.201107 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2261c25f-e765-4b88-aa4c-0d0f6f7a02cc tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.214235 Sep 13 19:53:04.201765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 167/335] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:03 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:05.009893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:05.011433 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:05.020543 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.021859 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.022502 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.023337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:05.025335 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:05.025940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.026797 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.028627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.064215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.069649 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.070982 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.071811 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.072303 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.072746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.383302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:05.395694 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:05.397537 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:05.398812 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2adaf2bb-1d14-42b3-b546-3448ad57b209 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.393450 Sep 13 19:53:05.420832 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:05.427563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 169/336] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:05 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:05.436062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-595b004a-2f7e-40cf-9bcf-a209ebf9ff50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.418263 Sep 13 19:53:05.437889 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 168/337] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:05 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:05.438073 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:05.438619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:05.449971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.450775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.451377 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.452291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:05.452922 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:05.453553 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:05.610640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:05.620290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-bf7cbb40-cc51-4bda-bc8d-bf58a7e2ce6c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.187674 Sep 13 19:53:05.631833 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 170/338] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:05 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:06.429368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:06.430064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:06.436770 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.437561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.438169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:06.439034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.439642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.440203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:06.473603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:06.475088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:06.482549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.485467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.486782 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:06.487805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.488491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.489148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:06.686270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:06.699277 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:06.701050 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:06.703937 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d72ee47f-95f5-4496-bd84-70d7964c5e3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.278500 Sep 13 19:53:06.705001 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 169/339] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:06 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:06.713419 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:06.715538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:06.725895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.727280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.728513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:06.729970 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:06.730540 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:06.731196 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:06.762844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:06.788622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a2f86825-4c81-49f5-aff4-35d78f30a1fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.320050 Sep 13 19:53:06.789566 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 171/340] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:06 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:06.935427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:06.943442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1947d656-8ae7-46fd-8d98-6d2056599dfd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.236366 Sep 13 19:53:06.944005 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 170/341] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:06 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:07.494444 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-dc25b399-a377-4249-bea7-98defd55ed9b req-d721f4a8-5286-4235-932e-f9c6bd7f9b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc2f361-c297-4a69-9898-d4d3cc310118", "name": "network-vif-plugged", "status": "completed", "tag": "8c0ed42f-e532-4877-8eca-a8af525da34e"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:07.513219 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-dc25b399-a377-4249-bea7-98defd55ed9b req-d721f4a8-5286-4235-932e-f9c6bd7f9b8d service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:07.513994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-dc25b399-a377-4249-bea7-98defd55ed9b req-d721f4a8-5286-4235-932e-f9c6bd7f9b8d service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:07.514691 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-dc25b399-a377-4249-bea7-98defd55ed9b req-d721f4a8-5286-4235-932e-f9c6bd7f9b8d service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:07.530164 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-dc25b399-a377-4249-bea7-98defd55ed9b req-d721f4a8-5286-4235-932e-f9c6bd7f9b8d service nova] Creating event network-vif-plugged:8c0ed42f-e532-4877-8eca-a8af525da34e for instance 9fc2f361-c297-4a69-9898-d4d3cc310118 on hv-cinder-82880 Sep 13 19:53:07.537169 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-dc25b399-a377-4249-bea7-98defd55ed9b req-d721f4a8-5286-4235-932e-f9c6bd7f9b8d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051272 Sep 13 19:53:07.538358 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 172/342] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:07.731085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:07.731716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:07.738923 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:07.739668 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:07.740273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:07.740993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:07.741606 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:07.742170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:07.747669 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:07.814074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:07.814847 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:07.821725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:07.835393 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:07.836719 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:07.845533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:07.846811 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:07.849277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:08.125012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:08.135519 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:08.137559 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:08.139194 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-858cd970-58ce-4bcf-b92f-720f8dbafd10 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.412934 Sep 13 19:53:08.139865 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 171/343] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:07 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:08.144309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:08.156172 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:08.157703 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:08.171124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5142f752-f457-44ff-9ce9-456d1b8133c6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.361255 Sep 13 19:53:08.185550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 173/344] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:07 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:08.193899 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:08.194742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:08.195500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:08.196650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:08.197073 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:08.197598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:08.456792 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:08.467478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-be7d0f6d-d2e5-4df7-99f4-b3b759e6628f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.326437 Sep 13 19:53:08.468088 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 172/345] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:08 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:09.171376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:09.172873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:09.176456 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:09.180108 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.180671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.181363 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.182134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.182803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.183289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.200199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:09.200796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:09.209758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.210247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.210697 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.211379 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.211992 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.212411 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.428837 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:09.443666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:09.445650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:09.447431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4e6f47b6-1264-4a07-ba01-cd3f3846d79b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.280339 Sep 13 19:53:09.448024 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 174/346] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:09 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:09.449808 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:09.463532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-00eaf631-0766-42eb-932d-feaa942e6725 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.266927 Sep 13 19:53:09.464980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 173/347] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:09 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:09.490537 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:09.491914 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:09.498316 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.499008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.499630 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.500489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.501639 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.502279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.561167 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-94954bdb-ac05-4234-9d20-647450c726dd req-5ce80921-62fb-4532-9ec5-02edabfdec1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b1b8b5-f84c-4ba9-9bf9-75535a05af91", "name": "network-vif-plugged", "status": "completed", "tag": "b09f2e8a-de1a-4977-93b0-5ea0ae7926e1"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:09.573467 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-94954bdb-ac05-4234-9d20-647450c726dd req-5ce80921-62fb-4532-9ec5-02edabfdec1e service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:09.574536 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-94954bdb-ac05-4234-9d20-647450c726dd req-5ce80921-62fb-4532-9ec5-02edabfdec1e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:09.575174 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-94954bdb-ac05-4234-9d20-647450c726dd req-5ce80921-62fb-4532-9ec5-02edabfdec1e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:09.591013 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-94954bdb-ac05-4234-9d20-647450c726dd req-5ce80921-62fb-4532-9ec5-02edabfdec1e service nova] Creating event network-vif-plugged:b09f2e8a-de1a-4977-93b0-5ea0ae7926e1 for instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 on hv-cinder-82880 Sep 13 19:53:09.596921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-94954bdb-ac05-4234-9d20-647450c726dd req-5ce80921-62fb-4532-9ec5-02edabfdec1e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039656 Sep 13 19:53:09.598443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 174/348] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:09.670149 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:09.678683 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-cb5c5ed8-9627-4683-adb2-4573f297e154 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.191884 Sep 13 19:53:09.679487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 175/349] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:09 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:10.478250 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:10.479674 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:10.487518 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.487870 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.488303 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.488436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:10.489262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:10.490044 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.490409 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.491128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.496297 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.497118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.497649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.498572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.499111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.499756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.707359 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:10.720332 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f6fccfc9-57a3-4123-a46c-c397066e670a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.236259 Sep 13 19:53:10.737504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 176/350] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:10 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:10.742666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:10.745716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:10.746609 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:10.751993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:10.753709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.754120 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:10.754317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.754814 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.755741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:10.756278 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:10.756659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-de9abc7b-7113-46a0-a7f5-a069a0709530 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.282866 Sep 13 19:53:10.756781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:10.757882 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 175/351] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:10 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:10.934057 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:10.942463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-738bbc60-f7f9-49e9-9f71-b63ea4b1efbd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.203859 Sep 13 19:53:10.961684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 177/352] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:10 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:11.753588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:11.754419 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:11.762715 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:11.763348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:11.763983 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:11.764692 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:11.765173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:11.765609 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:11.792235 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:11.793291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:11.808357 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:11.808855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:11.809312 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:11.810175 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:11.810638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:11.811063 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:12.227137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:12.239821 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d72fcbfd-616a-4d93-9bb1-686f2ac9a708 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.491439 Sep 13 19:53:12.241011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 176/353] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:11 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:12.246905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:12.247948 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:12.255155 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:12.256028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:12.256707 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:12.257902 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:12.258953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:12.259495 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:12.272901 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:12.283515 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:12.285231 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:12.287277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3c276a47-2ea9-4d81-b022-6ea6e13bef7c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.504163 Sep 13 19:53:12.288465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 178/354] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:11 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:12.406256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:12.418069 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0b8fdb30-64ed-40f5-a034-7a6011027e79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.174988 Sep 13 19:53:12.419040 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 177/355] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:12 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:13.266433 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:13.267414 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:13.275838 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:13.276383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:13.277280 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:13.278827 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:13.279285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:13.279831 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:13.316872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:13.319197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:13.327969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:13.328459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:13.329269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:13.330235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:13.330689 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:13.331108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:13.566080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:13.584766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:13.586548 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:13.588424 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-317fdd83-1993-495e-bc44-eb99417aaf04 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.277593 Sep 13 19:53:13.589917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 178/356] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:13 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:13.595011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:13.595862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:13.603891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:13.604851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:13.605560 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:13.606476 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:13.607068 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:13.607631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:13.842504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:13.855707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3b5993e1-e842-43e9-9376-cdd6f99fdd6f tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.591707 Sep 13 19:53:13.856251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 179/357] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:13 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:13.905158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:13.913715 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-277f2735-1017-45a8-974c-f574119e9fb4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1371 microversion: 2.1 time: 0.322567 Sep 13 19:53:13.914397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 179/358] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:13 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:14.615524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:14.616118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:14.623352 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.623833 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.624275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:14.625042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.625641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.625898 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:14.768868 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:14.771128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:14.778825 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:14.780249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:14.781452 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d6939cf5-70f3-4886-bad3-309d49ef1150 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1740 microversion: 2.20 time: 0.170026 Sep 13 19:53:14.781978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 180/359] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:14 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:14.883274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:14.883906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:14.890894 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.891381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.891815 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:14.892521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.893018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.893445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:14.940583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:14.941311 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:14.948154 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.948856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.949644 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:14.950761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:14.951222 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:14.951738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:15.115524 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:15.128827 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3d941c61-8936-4e4f-a310-e81cd45caf6a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.250346 Sep 13 19:53:15.129735 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 180/360] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:14 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:15.170162 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:15.178312 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2485f4fe-e43e-4ba0-904e-c357d26de5d0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1565 microversion: 2.1 time: 0.244798 Sep 13 19:53:15.178887 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 181/361] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:14 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1565 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:15.201221 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:15.201718 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:15.208429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:15.208922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:15.209388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:15.210106 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:15.210551 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:15.210972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:15.300173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-100a99af-234e-41fa-913d-34b6539d95d1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102928 Sep 13 19:53:15.300783 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 181/362] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 19:53:15 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:15.807610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:15.808249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:15.815191 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:15.815705 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:15.816145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:15.816907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:15.817379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:15.817805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:15.972200 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:15.981132 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:15.982570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:15.983753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a8e7ca44-24c1-4737-a4ce-5a9845d6b414 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1722 microversion: 2.20 time: 0.180154 Sep 13 19:53:15.984711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 182/363] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:15 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:16.157536 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:16.158393 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:16.160752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=80 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:16.167448 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:16.167936 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:16.168627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:16.169373 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:16.169814 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:16.170231 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:16.368084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:16.377454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-fdb66cf6-2822-4129-8d29-19e93d9810cc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.225083 Sep 13 19:53:16.378227 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 182/364] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:16 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:16.659080 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-3cff4bca-afbc-45bd-8d3b-9d68fe0b4b8e req-026a1334-837b-49e5-ba7f-242615988f27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b1b8b5-f84c-4ba9-9bf9-75535a05af91", "tag": "b09f2e8a-de1a-4977-93b0-5ea0ae7926e1"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:16.670483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3cff4bca-afbc-45bd-8d3b-9d68fe0b4b8e req-026a1334-837b-49e5-ba7f-242615988f27 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:16.671013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3cff4bca-afbc-45bd-8d3b-9d68fe0b4b8e req-026a1334-837b-49e5-ba7f-242615988f27 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:16.671388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3cff4bca-afbc-45bd-8d3b-9d68fe0b4b8e req-026a1334-837b-49e5-ba7f-242615988f27 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:16.682843 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-3cff4bca-afbc-45bd-8d3b-9d68fe0b4b8e req-026a1334-837b-49e5-ba7f-242615988f27 service nova] Creating event network-changed:b09f2e8a-de1a-4977-93b0-5ea0ae7926e1 for instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 on hv-cinder-82880 Sep 13 19:53:16.688431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-3cff4bca-afbc-45bd-8d3b-9d68fe0b4b8e req-026a1334-837b-49e5-ba7f-242615988f27 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033750 Sep 13 19:53:16.689060 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 183/365] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:17.009453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:17.010416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:17.016255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.016765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.017224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.017938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.018381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.018792 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.171127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:17.179846 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:17.181297 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:17.182462 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1073b5e0-27b1-4838-8531-a1a0a50cc07f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1722 microversion: 2.20 time: 0.176984 Sep 13 19:53:17.183053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 183/366] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:17 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:17.402286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:17.402966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:17.409631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.410151 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.410579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.411610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.412264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.412676 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.548800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:17.557281 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-65b3654a-3256-4924-8ad7-873536a7f54c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.159167 Sep 13 19:53:17.557861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 184/367] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:17 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:17.597431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-edc7c791-15ba-4064-b87b-7e87a175ddb5 req-ca1f2cff-e653-4cb6-a42f-dad8c364cda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc2f361-c297-4a69-9898-d4d3cc310118", "name": "network-vif-unplugged", "status": "completed", "tag": "8c0ed42f-e532-4877-8eca-a8af525da34e"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:17.608169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-edc7c791-15ba-4064-b87b-7e87a175ddb5 req-ca1f2cff-e653-4cb6-a42f-dad8c364cda9 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:17.608762 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-edc7c791-15ba-4064-b87b-7e87a175ddb5 req-ca1f2cff-e653-4cb6-a42f-dad8c364cda9 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:17.609259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-edc7c791-15ba-4064-b87b-7e87a175ddb5 req-ca1f2cff-e653-4cb6-a42f-dad8c364cda9 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:17.621967 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-edc7c791-15ba-4064-b87b-7e87a175ddb5 req-ca1f2cff-e653-4cb6-a42f-dad8c364cda9 service nova] Creating event network-vif-unplugged:8c0ed42f-e532-4877-8eca-a8af525da34e for instance 9fc2f361-c297-4a69-9898-d4d3cc310118 on hv-cinder-82880 Sep 13 19:53:17.627219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-edc7c791-15ba-4064-b87b-7e87a175ddb5 req-ca1f2cff-e653-4cb6-a42f-dad8c364cda9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033605 Sep 13 19:53:17.627847 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 184/368] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:18.207887 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:18.209251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:18.215427 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.215957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.216379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.217114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.217562 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.217983 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.427969 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:18.438478 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:18.440343 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:18.441840 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-872958b1-9088-4bad-997a-885d6f61031a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1722 microversion: 2.20 time: 0.238081 Sep 13 19:53:18.442612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 185/369] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:18 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:18.583734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:18.585075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:18.592139 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.593015 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.593525 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.594152 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:18.594610 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:18.595035 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:18.837940 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:18.852616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7cc82d95-a946-4e2b-886d-50ca76615281 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1722 microversion: 2.1 time: 0.274815 Sep 13 19:53:18.855242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 185/370] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:18 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:19.495039 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:19.495668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:19.502002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.502820 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.503253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.503963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.504415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.504835 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.698006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:19.712097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:19.715025 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:19.716592 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c7580ce7-5d64-44ca-a6a2-fac36375354a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1725 microversion: 2.20 time: 0.225502 Sep 13 19:53:19.717429 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 186/371] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:19 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:19.750952 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "463c91be-565c-46c7-a9ed-a5a3b834ee19"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:19.755593 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:19.768102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.768763 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.769239 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.770030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.770759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.771190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.889418 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:19.890082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:19.900329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.900845 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.904672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:19.905476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:19.905919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:19.906341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.078354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:20.089975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4fac7075-e584-4e0e-8efb-646a73437dc9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1699 microversion: 2.1 time: 0.210462 Sep 13 19:53:20.090616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 187/372] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:19 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1699 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:20.126908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-686f57f8-fd19-45ef-afaa-fd45d2321201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:20.135490 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-686f57f8-fd19-45ef-afaa-fd45d2321201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.135988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-686f57f8-fd19-45ef-afaa-fd45d2321201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.136426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-686f57f8-fd19-45ef-afaa-fd45d2321201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.216307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-686f57f8-fd19-45ef-afaa-fd45d2321201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Going to try to start instance {{(pid=132128) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 19:53:20.253259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:20.274084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ba49b733-8e53-41a5-b07a-3fb5350b8aad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.528931 Sep 13 19:53:20.275115 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 186/373] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Sep 13 19:53:19 2022] POST /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments => generated 188 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:53:20.289829 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-686f57f8-fd19-45ef-afaa-fd45d2321201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action" status: 202 len: 0 microversion: 2.1 time: 0.169596 Sep 13 19:53:20.291723 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 188/374] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:53:20 2022] POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:53:20.312309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:20.313113 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:20.329670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "030c736b-e48b-4784-a3c3-e4f7205ec5ad", "device": "/dev/sdb"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:20.332097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.332692 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.333196 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:20.333449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.334206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.334945 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.339516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.342514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.343003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.343628 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.344553 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.345205 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.345920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.668671 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:20.694397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-243464ac-f8b2-4d7d-a545-bbf0c1179e2e tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1708 microversion: 2.1 time: 0.398983 Sep 13 19:53:20.710116 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 187/375] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:20 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1708 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:20.719243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:20.720281 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:20.728043 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.728638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.729113 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.730304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:20.730866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:20.731300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:20.868099 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132127) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 19:53:20.926607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f6e7e794-f716-4043-9c91-fc11330a3d31 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "POST /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601448 Sep 13 19:53:20.928458 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 189/376] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:53:20 2022] POST /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:53:20.975958 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d4a5dbd2-a0d5-4e9c-861a-099f612a7ae2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/action" status: 202 len: 0 microversion: 2.20 time: 0.262827 Sep 13 19:53:20.976950 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 188/377] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 19:53:20 2022] POST /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:53:20.986215 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:20.987261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.000563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.003850 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.004299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.005743 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.006208 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.006631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.367343 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.382258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.384134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:21.385526 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a1102e2a-e24c-4458-8990-17209c534e85 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1751 microversion: 2.20 time: 0.404154 Sep 13 19:53:21.389119 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 190/378] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:20 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1751 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:21.722713 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:21.723722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:21.730891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.731777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.732641 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:21.733624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:21.734300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:21.735282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:22.135875 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:22.150252 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-fe5e95d9-0dea-406f-8d3b-cf251a50e498 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1708 microversion: 2.1 time: 0.431584 Sep 13 19:53:22.153374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 189/379] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:21 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1708 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:22.435905 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:22.436792 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:22.444627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:22.447534 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:22.451928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:22.452671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:22.456186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:22.456958 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:22.792842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:22.809426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:22.812736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:22.816027 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-62031f31-5b52-40ba-8455-e3c5aa1b85e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1751 microversion: 2.20 time: 0.384008 Sep 13 19:53:22.818570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 191/380] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:22 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1751 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:23.180582 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:23.181901 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:23.190932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:23.191739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:23.192223 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:23.193231 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:23.193748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:23.194230 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:23.680957 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:23.694335 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0269d298-bfa0-4b27-a229-3a1ebcb56743 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1708 microversion: 2.1 time: 0.521300 Sep 13 19:53:23.694929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 190/381] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:23 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1708 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:23.848477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:23.849677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:23.864085 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:23.864584 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:23.865041 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:23.866801 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:23.867271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:23.867694 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.071074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.085684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.087432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.088621 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-22a0a24a-2c67-4b74-8f26-3ec351c8d6ee tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1753 microversion: 2.20 time: 0.246064 Sep 13 19:53:24.089548 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 192/382] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:23 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1753 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:24.718568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:24.719173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:24.726241 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.726733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.727551 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.728263 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:24.728710 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:24.729137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:24.915222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:24.925459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bd04405a-75e7-4e97-bfbc-4e6a12c78310 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1712 microversion: 2.1 time: 0.211028 Sep 13 19:53:24.926433 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 191/383] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:24 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1712 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:25.119498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:25.120119 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:25.134908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.135466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.136070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.136857 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:25.137363 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:25.137789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:25.307579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.321253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.323285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:25.324749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4aafef15-34a7-45d4-97a1-120f0474a76d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1753 microversion: 2.20 time: 0.209276 Sep 13 19:53:25.325940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 193/384] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:25 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1753 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:26.351206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:26.352032 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:26.359403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.360175 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.361022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:26.362106 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:26.362772 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:26.363401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:26.577526 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:26.587426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:26.589644 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:26.590603 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9212c500-fc8f-4002-a958-1ddccf1f0cba tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1753 microversion: 2.20 time: 0.243381 Sep 13 19:53:26.591264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 192/385] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:26 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1753 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:27.626251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:27.627566 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:27.637363 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:27.637862 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:27.638305 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:27.639113 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:27.639461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:27.639889 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:27.814467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.828793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.831460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:27.833761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b1c1dc41-46c1-4471-b9c1-dfeb8728bec2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1753 microversion: 2.20 time: 0.218496 Sep 13 19:53:27.835518 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 194/386] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:27 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1753 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:28.864254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:28.865064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:28.873127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:28.873906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:28.874498 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:28.875250 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:28.875709 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:28.876132 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:29.155655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:29.166862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:29.168351 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:29.169717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-92a05863-656c-4d6f-b2e7-f1288d765aaf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1753 microversion: 2.20 time: 0.310535 Sep 13 19:53:29.171632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 193/387] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:28 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1753 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:30.195814 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:30.197227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:30.204243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:30.205173 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:30.205845 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:30.206793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:30.207482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:30.208178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:30.456577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:30.465348 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:30.480541 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:30.483191 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:30.484874 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-200eb335-240b-4de7-a1a5-1f44fa3ff0f2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1753 microversion: 2.20 time: 0.292871 Sep 13 19:53:30.486097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 195/388] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:30 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1753 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:31.511560 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:31.512453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:31.519376 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:31.520187 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:31.521043 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:31.521957 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:31.522536 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:31.522921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:31.688259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:31.699092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:31.700678 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:31.702299 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-311c5a2b-8017-4f4c-a746-07c5a1a0bcbe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1753 microversion: 2.20 time: 0.195162 Sep 13 19:53:31.702926 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 194/389] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:31 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1753 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:32.727789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:32.728353 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:32.737336 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:32.737915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:32.738549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:32.739436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:32.739953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:32.740608 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:32.963669 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:32.978494 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:32.982002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:32.983961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b67be7a5-c505-497f-9bbd-27f35eb8e328 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.260122 Sep 13 19:53:32.985126 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 196/390] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:32 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:34.012642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:34.013284 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:34.023018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:34.023507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:34.024109 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:34.026539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:34.027158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:34.027874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:34.255895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:34.265774 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:34.268212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:34.269874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ea18934b-43cf-4eb4-a295-0de5fdec1b92 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.262323 Sep 13 19:53:34.271111 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 195/391] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:34 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:35.320470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:35.321274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:35.329577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:35.329577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:35.330141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:35.330461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:35.330935 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:35.331344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:35.512028 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:35.524337 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:35.529061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:35.530733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-888407fc-b819-4f43-9b83-839d15daf9e7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.229600 Sep 13 19:53:35.546078 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 197/392] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:35 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:36.563082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:36.564651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:36.572542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:36.574213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:36.580286 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:36.581159 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:36.582073 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:36.582568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:36.809188 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:36.823953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:36.825837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:36.827354 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-58ddca59-9005-4c2f-8dce-71b555b86345 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.268841 Sep 13 19:53:36.828493 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 196/393] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:36 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:37.854997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:37.856228 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:37.868934 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:37.874605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:37.875980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:37.877822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:37.886044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:37.886932 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:38.244146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:38.254431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:38.257432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:38.258924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5bed4b63-b912-47ba-a9aa-948d86dfd92d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.409103 Sep 13 19:53:38.273427 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 198/394] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:37 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:39.289934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:39.291470 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:39.298497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:39.299444 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:39.300113 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:39.301207 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:39.301879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:39.302485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:39.511309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:39.523029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:39.524636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:39.526038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-476fc43d-7df5-4fb2-8c43-4c5cafbf7eb8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.243567 Sep 13 19:53:39.537661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 197/395] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:39 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:40.553988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:40.555571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:40.565891 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=50 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:40.567873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:40.568699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:40.569761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:40.570727 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:40.571442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:40.572203 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:40.758207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:40.769915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:40.771600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:40.772902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-91c83282-25be-4b75-b414-e304574b4867 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.222942 Sep 13 19:53:40.773837 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 199/396] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:40 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:41.799813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:41.804326 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:41.818705 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:41.819334 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:41.819964 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:41.825806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:41.826354 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:41.826811 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:41.994410 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:42.005568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:42.007595 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:42.010994 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8133885b-7395-4cd7-b31f-31adc2dd7117 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.213981 Sep 13 19:53:42.026421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 198/397] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:41 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:42.216641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-eee19720-78e8-4bf0-a595-e32ef613abd6 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Action: 'create', calling method: .version_select at 0x7f98b6b9a160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1633994995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdxMOs8PlnJaJUZZL9OsofPLRE6O5aUc3AtuC/Tz9L7WUSqkLDESxl2AMilLUgOzMYFDZD36uiipxpz8bXM9sZUVgyfaOkPwZL1nK07D27fwNj+VHxvxISQ3UhGhaka0A=="}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:42.241307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-eee19720-78e8-4bf0-a595-e32ef613abd6 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Getting quotas for project 845d6ae8d6434c4c96e24cf39f309d23. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:53:42.246003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-eee19720-78e8-4bf0-a595-e32ef613abd6 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Getting quotas for user 771ba65bd2974845ac79d04ad3634c96 and project 845d6ae8d6434c4c96e24cf39f309d23. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:53:42.279170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-eee19720-78e8-4bf0-a595-e32ef613abd6 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.067230 Sep 13 19:53:42.280102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 200/398] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:53:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:53:42.351153 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-566045880", "imageRef": "18be5101-45ed-461d-86f6-a87fb9193b5d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1633994995", "networks": [{"uuid": "a4cbb41e-bf45-46d0-9e7a-8d8d63808263"}]}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:42.435395 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] validate_networks() for [('a4cbb41e-bf45-46d0-9e7a-8d8d63808263', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:53:43.040836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:43.041480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:43.048430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.049318 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.050149 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.051203 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.051892 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.052525 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.102425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:53:43.103407 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:53:43.104023 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:53:43.104291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:53:43.104722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:53:43.118256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.118766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.119195 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.120128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:43.120567 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:43.121183 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:43.140427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Getting quotas for project 845d6ae8d6434c4c96e24cf39f309d23. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:53:43.145173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Getting quotas for user 771ba65bd2974845ac79d04ad3634c96 and project 845d6ae8d6434c4c96e24cf39f309d23. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:53:43.159681 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:53:43.162442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='18be5101-45ed-461d-86f6-a87fb9193b5d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:53:43.215267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f85fb12b-cb28-463d-b804-92a5e103d8d2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868243 Sep 13 19:53:43.215722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.216226 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 199/399] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:53:43.226985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-40d19fa1-373d-4cee-af92-1718cde9241c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:43.229520 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-40d19fa1-373d-4cee-af92-1718cde9241c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:43.239633 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.245757 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.247248 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-87c7bb70-e86d-480f-9ce1-401c90a297ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.211126 Sep 13 19:53:43.248005 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 201/400] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:43 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:43.307523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-40d19fa1-373d-4cee-af92-1718cde9241c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:43.316486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-40d19fa1-373d-4cee-af92-1718cde9241c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1258 microversion: 2.1 time: 0.093247 Sep 13 19:53:43.318730 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 200/401] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:43 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1258 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:44.274134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:44.274866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:44.282586 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.283181 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.283719 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.284614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.285231 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.286290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.341349 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:44.342108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:44.349393 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.349861 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.350279 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.351008 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:44.351449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:44.351858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:44.433538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.442444 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e513760b-c191-4188-812f-71a36bf45bfb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1262 microversion: 2.1 time: 0.104833 Sep 13 19:53:44.443633 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 201/402] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:44 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1262 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:44.467140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.476604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.478114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:44.479279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ba375c30-9e11-4638-8f5e-e87f15ee3bc3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.209233 Sep 13 19:53:44.479990 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 202/403] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:44 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:45.466093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:45.467447 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:45.470162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 19:53:45.470431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Tue Sep 13 19:53:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b (ip 10.222.0.18) !!! Sep 13 19:53:45.480577 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.481099 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.481531 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:45.482328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.482780 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.483201 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:45.506027 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:45.507679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:45.514804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.515275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.515699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:45.516430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.516873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.517315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:45.557748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:45.566607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6c41085a-544b-4732-b230-2524f342923f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1262 microversion: 2.1 time: 0.104497 Sep 13 19:53:45.573036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 202/404] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:45 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:45.670161 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:45.682559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:45.684040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:45.685445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-713f0191-e327-43ff-8cd0-d4c698e0275c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.183469 Sep 13 19:53:45.686026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 203/405] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:45 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:53:45.821453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:45.822098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:45.828685 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.829249 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.830030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:45.830662 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:45.831159 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:45.831664 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:45.964001 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lazy-loading 'services' on Instance uuid 3d98e739-aa2a-4dff-971d-c5afbe05f847 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:53:45.966317 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:46.094893 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5af43739-c005-45aa-be33-43b1f389382b tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847/os-volume_attachments/030c736b-e48b-4784-a3c3-e4f7205ec5ad" status: 202 len: 0 microversion: 2.1 time: 0.277595 Sep 13 19:53:46.095748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 203/406] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:53:45 2022] DELETE /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847/os-volume_attachments/030c736b-e48b-4784-a3c3-e4f7205ec5ad => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:53:46.589638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:46.590279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:46.597026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.597461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.597886 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.598572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.599021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.599445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.664929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.674723 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b561c257-f4a8-4c38-bc15-bb7fc7eaf094 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1262 microversion: 2.1 time: 0.088607 Sep 13 19:53:46.675450 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 204/407] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:46 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:46.712760 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:46.713426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:46.715419 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:46.721020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.721496 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.721919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.722632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:46.723072 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:46.723458 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:46.888727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.898513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.899940 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:46.901166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f64e4563-784d-4847-8984-8301011626e4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.193264 Sep 13 19:53:46.901921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 204/408] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:46 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:47.697047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:47.697715 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:47.704295 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.704781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.705232 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.705966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.706413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.706790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.774083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:47.782745 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fe9d5773-42af-4e15-98bd-7f2ba0980dae tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1262 microversion: 2.1 time: 0.089604 Sep 13 19:53:47.784128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 205/409] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:47 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:47.927986 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:47.928665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:47.935584 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.936064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.936532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:47.937374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:47.937691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:47.938130 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.079625 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:48.089592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:48.091280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:48.092528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8d7df4d1-942e-4442-8d38-9b87a3377995 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.168647 Sep 13 19:53:48.093101 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 205/410] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:47 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:48.807034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:48.807787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:48.814957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.815430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.815880 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.816585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:48.817068 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:48.817568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:48.879337 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:48.887236 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3253d374-1b05-4b1d-8411-e0ea1eb003aa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1254 microversion: 2.1 time: 0.084151 Sep 13 19:53:48.887808 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 206/411] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:48 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1254 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:49.120076 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:49.120650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:49.127504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.127967 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.128391 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.129151 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.129602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.130014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.264198 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:49.273094 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:49.274523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:49.275701 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5e88f8bc-083a-4692-875f-c3581475bbf4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.161618 Sep 13 19:53:49.276256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 206/412] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:49 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:49.910602 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:49.911611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:49.918465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.918884 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.919319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.920032 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:49.920492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:49.920905 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:49.985230 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:49.993262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b57dc47f-c895-4491-a999-b928483aa180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1310 microversion: 2.1 time: 0.086667 Sep 13 19:53:49.993846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 207/413] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:49 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:50.304866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:50.306034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:50.317267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.318125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.318895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.320024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.320742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.321707 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.437012 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:50.438251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:50.450415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.451276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.452267 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.453689 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.454547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.455838 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.500700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:50.507901 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:53:50.516235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:50.517923 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:50.519399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e38bde9f-b1d1-4ad7-b73e-ec374c99aac5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.222005 Sep 13 19:53:50.520586 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 207/414] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:50 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:50.592841 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6b0d4ab6-af72-4caf-af02-041380223571 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 204 len: 0 microversion: 2.1 time: 0.161623 Sep 13 19:53:50.593391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 208/415] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:53:50 2022] DELETE /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:53:50.601841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:50.602475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:50.609740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.610736 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.611279 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.612082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:50.612530 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:50.613025 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:50.769906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:50.778059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f24c5abf-2f0b-406d-bb5b-88921d8da352 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.180024 Sep 13 19:53:50.778673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 208/416] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:50 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:51.017704 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:51.018483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:51.025229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.025724 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.026160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.026876 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.027338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.027778 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.195878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:51.208467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-00c44ced-cb61-47aa-9281-489fc85aa6c0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.195259 Sep 13 19:53:51.210273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 209/417] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:51 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:51.546695 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:51.547289 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:51.554220 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.554707 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.555137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.555853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.556301 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.556722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.705141 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:51.714252 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:51.715673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:51.716845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b642f5c9-dcd7-4408-b99a-58fb9a854e17 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.174132 Sep 13 19:53:51.717765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 209/418] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:51 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:51.802712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:51.803334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:51.810074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.810549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.810976 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.811657 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:51.812097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:51.812510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:51.948908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:51.957459 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5dcb6cc8-7b6b-49f2-b16f-94571c95c612 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.158879 Sep 13 19:53:51.958038 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 210/419] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:51 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:52.237270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:52.238240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:52.248421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.249377 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.249999 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.251290 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.252205 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.253224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.437663 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:52.451242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-524bee26-b46c-4653-b0ca-12c607156165 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.221097 Sep 13 19:53:52.468077 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 210/420] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:52 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:52.746615 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:52.748361 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:52.756864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=4 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:52.760505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.761390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.762083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.762963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.763707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.764571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.975485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:52.981426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:52.982096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:52.991030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.991414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.991845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:52.991975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:52.992542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:52.994741 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:52.995389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:53.002855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:53.005432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:53.006795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-47302335-757c-402f-83b6-4c4c5d3bf497 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.266989 Sep 13 19:53:53.009288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 211/421] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:52 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:53.129517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:53.263528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:53.282265 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-016ce044-6ea8-4f7e-a30d-eda2eaf43004 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.305032 Sep 13 19:53:53.283800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 211/422] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:52 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:53:53.326381 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-cc7151da-9708-418c-86fa-1bcd95486e68 req-1581435b-be51-4d47-9753-8a76d423ccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2129723c-9cf0-42d5-81be-81547f40b36b", "tag": "0a8426a0-9e45-4b77-aa52-3f03d1426e6c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:53.352626 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cc7151da-9708-418c-86fa-1bcd95486e68 req-1581435b-be51-4d47-9753-8a76d423ccd2 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:53.353181 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cc7151da-9708-418c-86fa-1bcd95486e68 req-1581435b-be51-4d47-9753-8a76d423ccd2 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:53.353621 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cc7151da-9708-418c-86fa-1bcd95486e68 req-1581435b-be51-4d47-9753-8a76d423ccd2 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:53.374821 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-cc7151da-9708-418c-86fa-1bcd95486e68 req-1581435b-be51-4d47-9753-8a76d423ccd2 service nova] Creating event network-changed:0a8426a0-9e45-4b77-aa52-3f03d1426e6c for instance 2129723c-9cf0-42d5-81be-81547f40b36b on hv-cinder-82880 Sep 13 19:53:53.379997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-cc7151da-9708-418c-86fa-1bcd95486e68 req-1581435b-be51-4d47-9753-8a76d423ccd2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058254 Sep 13 19:53:53.380977 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 212/423] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:53:53.477844 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:53.478449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:53.480272 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=8 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:53.487461 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:53.487950 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:53.488383 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:53.489143 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:53.489591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:53.490042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:53.640300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:53.648830 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7a847864-458e-4bd3-9f39-33aca47085c1 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.175131 Sep 13 19:53:53.652952 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 212/424] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:53 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:54.041006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:54.041721 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:54.049033 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:54.049634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:54.050142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:54.050938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:54.051466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:54.052102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:54.202826 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:54.214392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:54.216415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:54.218477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-16d66468-8cc2-44b7-adf1-d2edae875f47 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.182557 Sep 13 19:53:54.224953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 213/425] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:54 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:54.310645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:54.311315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:54.318199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:54.318688 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:54.319123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:54.319821 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:54.320455 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:54.320916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:54.463851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:54.473723 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-038ba5b4-ecd9-4b20-9c60-2b043930647a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.166953 Sep 13 19:53:54.474714 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 213/426] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:54 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:54.672459 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:54.673841 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:54.681157 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:54.681826 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:54.682301 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:54.683141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:54.683720 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:54.684480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:54.826408 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:54.839436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-17dec24b-6d27-4bc1-8dc5-c5673b9ab3dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.167952 Sep 13 19:53:54.844429 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 214/427] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:54 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:55.243903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:55.244516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:55.250791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.251280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.251713 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:55.252451 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.252917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.253363 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:55.394497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:55.403639 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:55.405617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:55.407053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d3a9a2a2-7d10-4561-bb9c-f95f55660dad tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.167140 Sep 13 19:53:55.407689 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 214/428] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:55 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:55.501311 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:55.501998 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:55.509225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.509716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.510145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:55.510856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.511302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.511721 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:55.658406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:55.667115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0d64b473-dd2a-45a5-b1da-87ad7d14e8ae tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.170544 Sep 13 19:53:55.667762 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 215/429] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:55 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:55.859581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:55.860431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:55.867471 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.868130 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.868669 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:55.869885 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:55.870036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:55.870638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.012980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:56.021618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b7ce6717-aa3d-4188-9363-99d8175a58dc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.166109 Sep 13 19:53:56.022563 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 215/430] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:55 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:56.433709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:56.434313 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:56.441517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:56.442269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:56.442980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.443741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:56.444264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:56.444759 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.598193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:56.610059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:56.611603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:56.612864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f2387f94-d293-4eef-a008-a93f64a6227c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.183232 Sep 13 19:53:56.613446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 216/431] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:56 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:56.690285 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:56.690879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:56.698397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:56.698884 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:56.699311 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.700380 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:56.701114 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:56.701822 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.871548 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:56.888166 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-3a3a9fe3-5cd6-4628-92d5-9504c0352a20 req-746689bf-d008-42d4-8658-0f69b519f375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d98e739-aa2a-4dff-971d-c5afbe05f847", "name": "network-vif-unplugged", "status": "completed", "tag": "25661ba9-640d-477f-829b-4a3601204167"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:53:56.888779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dfca439c-4484-4e93-9c90-793d6e230fc5 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.202682 Sep 13 19:53:56.901451 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 216/432] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:56 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:56.910580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3a3a9fe3-5cd6-4628-92d5-9504c0352a20 req-746689bf-d008-42d4-8658-0f69b519f375 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:56.911600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3a3a9fe3-5cd6-4628-92d5-9504c0352a20 req-746689bf-d008-42d4-8658-0f69b519f375 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:56.912031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3a3a9fe3-5cd6-4628-92d5-9504c0352a20 req-746689bf-d008-42d4-8658-0f69b519f375 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:56.925875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-3a3a9fe3-5cd6-4628-92d5-9504c0352a20 req-746689bf-d008-42d4-8658-0f69b519f375 service nova] Creating event network-vif-unplugged:25661ba9-640d-477f-829b-4a3601204167 for instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 on hv-cinder-82880 Sep 13 19:53:56.932533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-3a3a9fe3-5cd6-4628-92d5-9504c0352a20 req-746689bf-d008-42d4-8658-0f69b519f375 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048083 Sep 13 19:53:56.933510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 217/433] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:53:57.047908 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:57.049307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:57.056555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.057168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.057605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:57.058348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.058824 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.059276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:57.197719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:57.208235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4f1f870e-bd98-44f3-9604-b8c0b26db427 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.165641 Sep 13 19:53:57.209457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 217/434] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:57 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:57.640876 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:57.642476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:57.649455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.649950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.650413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:57.651083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.651534 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.652158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:57.809481 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:57.818249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:57.819680 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:57.820866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ab2ca968-5422-4dab-ad18-98a7fdd12c87 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.184411 Sep 13 19:53:57.821452 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 218/435] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:57 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:57.914589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:57.915253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:57.922556 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.923084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.923519 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:57.924327 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:57.924783 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:57.925242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:58.072864 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:58.081430 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b017721b-acf2-4f95-9f10-d13c2b1f5956 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.171146 Sep 13 19:53:58.086059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 218/436] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:57 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:58.231957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:58.233728 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:58.242050 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:58.242567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:58.242995 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:58.243816 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:58.244338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:58.244764 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:58.394904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:58.404091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ad3d0650-d928-4943-9a34-9e632de861be tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.176099 Sep 13 19:53:58.405118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 219/437] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:58 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:58.847877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:58.848628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:58.854997 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:58.855453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:58.855890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:58.856593 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:58.857078 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:58.857499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:58.999492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:59.009338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:59.010791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:59.011990 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-31053aba-86a4-47a0-97d0-006c06958d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.168223 Sep 13 19:53:59.012929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 219/438] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:53:58 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:53:59.106746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:59.107377 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:59.114466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:59.114947 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:59.115368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:59.116070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:59.116514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:59.116954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:59.261070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:59.269279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-06534963-3512-468f-ac1f-acb1cff1ff84 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.167147 Sep 13 19:53:59.269861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 220/439] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:59 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:53:59.428108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:53:59.428622 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:53:59.435507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:59.435966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:59.436423 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:59.437434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:53:59.437884 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:53:59.438391 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:53:59.441421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:59.585439 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:53:59.594169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a3597e38-cb0d-444d-8324-0bf67b01dbec tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.170099 Sep 13 19:53:59.599399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 220/440] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:53:59 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:00.038157 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:00.038764 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:00.045823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.046322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.046845 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.047700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.048156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.048577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.190266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:00.200417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:00.202319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:00.203774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-df6375cf-f22d-43ab-a2d8-0b74b334a96d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.169939 Sep 13 19:54:00.204570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 221/441] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:00 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:00.294189 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:00.294946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:00.301809 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.302323 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.302751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.303453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.303894 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.304284 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.448118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:00.456307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b8c24a22-d0ed-43c5-bb35-e6a29eab9027 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.166045 Sep 13 19:54:00.457125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 221/442] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:00 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:00.617825 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:00.618556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:00.624699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.625231 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.625662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.626350 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:00.626798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:00.627211 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:00.770238 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:00.778584 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-cbd1ccc4-0a97-4713-8f5f-4a6fb11b30b9 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.165407 Sep 13 19:54:00.779160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 222/443] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:00 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:01.230261 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:01.230863 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:01.237604 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.238081 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.238507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.239179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.239625 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.240042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.370496 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:01.379594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:01.381037 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:01.382200 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ca5262cb-4371-49b8-8e3f-f68bc127fdfe tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.155934 Sep 13 19:54:01.382758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 222/444] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:01 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:01.479931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:01.480816 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:01.487704 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.488182 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.488616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.489340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.489787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.490201 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.633647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:01.642740 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c1b52b79-1a49-45b7-80ee-82d834720b8a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1513 microversion: 2.1 time: 0.166551 Sep 13 19:54:01.643447 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 223/445] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:01 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:01.802449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:01.803900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:01.810428 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.810913 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.811334 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.812021 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:01.812461 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:01.812873 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:01.946435 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:01.954624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-21a01cc1-18c7-46f6-a844-fa9112b33490 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.156039 Sep 13 19:54:01.955197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 223/446] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:01 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:02.408083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:02.408781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:02.416497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.417029 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.417470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.418168 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.418606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.419031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.484273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c074390-f63f-4c9a-8ea5-f22927d1f939"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:02.487247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:02.493959 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.494806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.495075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.495765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.496292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.496759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.716061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:02.725805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:02.727656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:02.729117 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ab556ad2-c8c0-4d2e-862b-d47093d1a066 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.325009 Sep 13 19:54:02.729884 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 224/447] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:02 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:02.734816 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:02.735700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:02.742882 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.743641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.744289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.745738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.746485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.747109 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.832752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-82c8c75a-f927-4098-bc4a-ad5dc29a716a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352311 Sep 13 19:54:02.833591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 224/448] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:54:02 2022] POST /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:54:02.849955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-7bd09b5a-0fd0-4dbc-9df7-396a643a3c09 req-95cd5b09-383e-4018-b4d7-852eddd9713c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d98e739-aa2a-4dff-971d-c5afbe05f847", "name": "network-vif-deleted", "tag": "25661ba9-640d-477f-829b-4a3601204167"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:02.869567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:02.873804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7bd09b5a-0fd0-4dbc-9df7-396a643a3c09 req-95cd5b09-383e-4018-b4d7-852eddd9713c service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.874290 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7bd09b5a-0fd0-4dbc-9df7-396a643a3c09 req-95cd5b09-383e-4018-b4d7-852eddd9713c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.874710 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7bd09b5a-0fd0-4dbc-9df7-396a643a3c09 req-95cd5b09-383e-4018-b4d7-852eddd9713c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.881307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b766b64f-db6b-4e0e-9899-ee86e5bca4f4 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 200 len: 1471 microversion: 2.1 time: 0.150168 Sep 13 19:54:02.882441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 225/449] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:02 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:02.890441 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-7bd09b5a-0fd0-4dbc-9df7-396a643a3c09 req-95cd5b09-383e-4018-b4d7-852eddd9713c service nova] Creating event network-vif-deleted:25661ba9-640d-477f-829b-4a3601204167 for instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 on hv-cinder-82880 Sep 13 19:54:02.896420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-7bd09b5a-0fd0-4dbc-9df7-396a643a3c09 req-95cd5b09-383e-4018-b4d7-852eddd9713c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060930 Sep 13 19:54:02.897414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 225/450] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:02.978182 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:02.978785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:02.989912 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.990486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.991024 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:02.992309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:02.993040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:02.993641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.217359 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:03.225282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-093a5365-3440-4d1a-a4f6-8c5c7f56e271 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.250909 Sep 13 19:54:03.225839 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 226/451] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:02 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:03.756517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:03.757247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:03.765369 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:03.766030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:03.766460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.767159 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:03.767663 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:03.768081 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.905652 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:03.908413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:03.909045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 3d98e739-aa2a-4dff-971d-c5afbe05f847] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:03.915613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:03.915823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:03.916074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:03.916513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.917237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:03.917372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:03.917666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:03.918108 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:03.918597 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-cc16d53a-9279-48f6-8c9d-51e4eeef3da7 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.167098 Sep 13 19:54:03.919161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 226/452] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:03 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:03.932390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] HTTP exception thrown: Instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 could not be found. Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Request method failure captured: Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 HTTP/1.1 Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN9-fJTnM8_oELCO6Qs-OPRiI6IZxGUUnfU55jeqYSlF4ZHNjrsAPLlAmcQ93CyqYi-zDmMI2FoOKp4xUZgFGEOdkJDaLCQLeoJjGks9RmgaNBKcqSMP42ONdp7KJsTcq4nF9j_JEnwRBQBIRI7Ygk_PZsS21IBvAnRM79WK72rWbvc Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: fa70232219304082b5ee608a7ea61c22 Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1598337191 Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:54:03.934079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa70232219304082b5ee608a7ea61c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa70232219304082b5ee608a7ea61c22", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa70232219304082b5ee608a7ea61c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa70232219304082b5ee608a7ea61c22"}]}] Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesSnapshotTestJSON-1598337191 Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: fa70232219304082b5ee608a7ea61c22 Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1598337191 Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesSnapshotTestJSON-1598337191-project Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 11c76c57183e406c87f434841fc13b43 Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesSnapshotTestJSON-1598337191-project Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 could not be found. Sep 13 19:54:03.935375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '3d98e739-aa2a-4dff-971d-c5afbe05f847'} Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 could not be found. Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:54:03.936114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 could not be found. Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 could not be found. Sep 13 19:54:03.937671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:03.938763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Returning 404 to user: Instance 3d98e739-aa2a-4dff-971d-c5afbe05f847 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:54:03.938763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-becf6492-ac0d-40dd-9ac2-117156e0474d tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847" status: 404 len: 111 microversion: 2.1 time: 0.031539 Sep 13 19:54:03.939335 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 227/453] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:03 2022] GET /compute/v2.1/servers/3d98e739-aa2a-4dff-971d-c5afbe05f847 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:54:04.248458 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:04.249187 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:04.256280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:04.256762 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:04.257235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:04.257930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:04.258376 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:04.258801 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:04.395600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:04.403926 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e0908c95-b4b8-40f2-a974-60c75bb02e7e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.159414 Sep 13 19:54:04.404494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 227/454] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:04 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:04.944056 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:04.944678 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:04.954022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:04.954814 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:04.955520 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:04.956656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:04.957438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:04.958130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:05.094833 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:05.103487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:05.104915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:05.106084 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ccbd0da0-07d5-430b-b5f4-17feaa2caed3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.166398 Sep 13 19:54:05.106929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 228/455] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:04 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:05.430758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:05.431390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:05.438213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:05.438690 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:05.439114 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:05.439792 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:05.440233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:05.440645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:05.569290 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:05.580053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-aa399442-a49b-49d6-b4d0-5a822d433a28 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.153192 Sep 13 19:54:05.580675 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 228/456] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:05 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:06.131947 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:06.132543 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:06.139508 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.139984 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.140407 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.141100 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.141560 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.141975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.282714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:06.292632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:06.294114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:06.295311 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-83f3189f-1883-472e-9ded-1ac05b040237 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.167726 Sep 13 19:54:06.295883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 229/457] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:06 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:54:06.602743 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:06.603384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:06.610474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.610956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.611387 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.612093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:06.612540 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:06.612998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:06.746533 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:06.754624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5f3e9292-43a6-4573-83ad-2661266728d3 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.155787 Sep 13 19:54:06.755185 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 229/458] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:06 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:07.322082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:07.322972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:07.323164 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:07.323745 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:07.334928 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.335731 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.336415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.337638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.337872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.338347 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.338747 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.339014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.339472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.340685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.341637 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.342151 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.359598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:07.430361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lazy-loading 'services' on Instance uuid abd47672-e41a-48a6-a6ca-b89eb476d3a6 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:54:07.486047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:07.496484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:07.498426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:07.500333 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e82f3424-6049-4ffa-bb1c-57d5a0e5a116 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.181736 Sep 13 19:54:07.501376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 230/459] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:07 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:07.518581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3c1e83d9-4c35-48f9-8beb-9a1a83582e22 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-volume_attachments/f7cae326-3375-45b8-985e-78cd03bc39d4" status: 202 len: 0 microversion: 2.1 time: 0.199365 Sep 13 19:54:07.519722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 230/460] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:54:07 2022] DELETE /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-volume_attachments/f7cae326-3375-45b8-985e-78cd03bc39d4 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 19:54:07.781940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:07.782515 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:07.789349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.789834 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.790296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.790978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:07.791460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:07.791838 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:07.923259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:07.931481 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f5ed009b-1a44-42cb-985b-ea6cc3d177ab tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.153587 Sep 13 19:54:07.932049 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 231/461] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:07 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:08.527480 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:08.528165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:08.535177 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:08.535657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:08.536468 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:08.537189 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:08.537622 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:08.538036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:08.684062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:08.692769 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:08.694256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:08.695416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f354f83d-e42c-47cf-98f1-fcc8aee719ff tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.172268 Sep 13 19:54:08.696740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 231/462] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:08 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:08.956133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:08.956993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:08.963614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:08.964103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:08.964534 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:08.965284 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:08.965735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:08.966159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:09.103875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:09.112017 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fe4237e9-5478-4902-b285-4b810819194b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.160044 Sep 13 19:54:09.112584 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 232/463] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:08 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:09.370128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-bef2774b-28a9-424a-b54c-5e447cb2b94b req-4a26f211-b489-4f55-a976-0981257cc2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc2f361-c297-4a69-9898-d4d3cc310118", "name": "network-vif-plugged", "status": "completed", "tag": "8c0ed42f-e532-4877-8eca-a8af525da34e"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:09.380650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bef2774b-28a9-424a-b54c-5e447cb2b94b req-4a26f211-b489-4f55-a976-0981257cc2a8 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:09.381140 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bef2774b-28a9-424a-b54c-5e447cb2b94b req-4a26f211-b489-4f55-a976-0981257cc2a8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:09.381544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bef2774b-28a9-424a-b54c-5e447cb2b94b req-4a26f211-b489-4f55-a976-0981257cc2a8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:09.395549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-bef2774b-28a9-424a-b54c-5e447cb2b94b req-4a26f211-b489-4f55-a976-0981257cc2a8 service nova] Creating event network-vif-plugged:8c0ed42f-e532-4877-8eca-a8af525da34e for instance 9fc2f361-c297-4a69-9898-d4d3cc310118 on hv-cinder-82880 Sep 13 19:54:09.400541 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-bef2774b-28a9-424a-b54c-5e447cb2b94b req-4a26f211-b489-4f55-a976-0981257cc2a8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034343 Sep 13 19:54:09.401190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 232/464] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:09.720247 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:09.720844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:09.727005 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:09.727479 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:09.727907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:09.728591 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:09.729068 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:09.729493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:09.866488 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:09.876725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:09.878281 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:09.879537 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-944058c7-0ed1-4f1e-b433-5abbc9c9d22d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.163287 Sep 13 19:54:09.880179 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 233/465] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:09 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:10.135482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:10.136551 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:10.146584 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.147271 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.147982 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.149009 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.149682 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.150316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.440477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:10.442931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:10.449780 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.450258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.450677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.451383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.451823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.452239 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.477948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'flavor' on Instance uuid a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:54:10.524353 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:10.532570 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-67829648-4464-458e-9529-0135fad01acf tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.402363 Sep 13 19:54:10.533208 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 233/466] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:10 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:10.642771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-694602c0-18e0-49ac-98a8-3afca1875931 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/action" status: 200 len: 32 microversion: 2.1 time: 0.206285 Sep 13 19:54:10.643376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 234/467] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:54:10 2022] POST /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:54:10.653696 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:10.654258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:10.660267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.660759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.661585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.662748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.662748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.663103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.797329 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:10.806414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-af56f185-b5ef-4502-b11b-f6c20d13a7ce tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.157267 Sep 13 19:54:10.807007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 234/468] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:10 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:10.910471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:10.911468 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:10.913756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:10.919727 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.920214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.920637 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:10.921390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:10.921836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:10.922253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.070686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:11.079860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:11.081330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:11.082483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5a4aa55b-d7f9-4708-b95b-f37c35e630f5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.176862 Sep 13 19:54:11.083055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 235/469] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:10 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:11.556637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:11.557255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:11.563959 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.564448 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.564907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.565618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.566204 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.566629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.702886 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:11.711629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3c719bcb-56d6-447b-9644-1ebcf7810642 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.159199 Sep 13 19:54:11.712197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 235/470] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:11 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:11.829983 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:11.830562 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:11.837868 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.838352 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.838782 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.839474 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:11.839909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:11.840318 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:11.981946 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:11.990814 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-27885ec3-eb71-42d5-b3eb-87fe3d7e23c6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.164651 Sep 13 19:54:11.991380 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 236/471] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:11 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:12.108110 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:12.108632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:12.115203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.115673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.116133 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.116862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.117333 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.117780 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.120544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:12.252698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:12.262459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:12.265342 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:12.266594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6fb73616-64ff-4c98-ab98-e4aa8327c6bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.162540 Sep 13 19:54:12.267622 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 236/472] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:12 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:12.734430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:12.735051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:12.743641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.744265 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.744730 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.745517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:12.745975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:12.746409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:12.849768 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-175791667", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "networks": [{"uuid": "e6a79854-63f4-40b5-99e7-83725bff6789"}]}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:12.912592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] validate_networks() for [('e6a79854-63f4-40b5-99e7-83725bff6789', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:54:12.912775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:12.921430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c599e4d1-f5bb-46b7-b4b5-04bccb7d525c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.190802 Sep 13 19:54:12.934272 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 237/473] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:12 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:13.014797 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:13.015374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:13.024551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.025754 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.026470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.027402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.028796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.030470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.266911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:13.275701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-abb05bf7-a51a-4b08-b294-4df44afd7f4a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.265228 Sep 13 19:54:13.276286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 238/474] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:13 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:13.297289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:13.297906 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:13.304549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.305083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.305505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.306221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.306680 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.307094 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.464594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:54:13.465183 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:54:13.465590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:54:13.466032 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:54:13.466450 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:54:13.475826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.476310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.476750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.477515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.477972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.478391 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.493771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:13.497641 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Getting quotas for project fa70232219304082b5ee608a7ea61c22. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:54:13.502717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Getting quotas for user 11c76c57183e406c87f434841fc13b43 and project fa70232219304082b5ee608a7ea61c22. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:54:13.504291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:13.505933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:13.507347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-32769144-b70d-4e23-b383-f0f409b06dfa tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.214092 Sep 13 19:54:13.517028 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 239/475] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:13 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:13.517243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:54:13.517779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:54:13.553609 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-d44550fe-4c9b-4f28-984f-9e206355cdf1 req-2ca9f14e-7f72-4c52-b227-8bd30e7a2b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2129723c-9cf0-42d5-81be-81547f40b36b", "name": "network-vif-plugged", "status": "completed", "tag": "0a8426a0-9e45-4b77-aa52-3f03d1426e6c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:13.566939 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d44550fe-4c9b-4f28-984f-9e206355cdf1 req-2ca9f14e-7f72-4c52-b227-8bd30e7a2b7c service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.567421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d44550fe-4c9b-4f28-984f-9e206355cdf1 req-2ca9f14e-7f72-4c52-b227-8bd30e7a2b7c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.568145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d44550fe-4c9b-4f28-984f-9e206355cdf1 req-2ca9f14e-7f72-4c52-b227-8bd30e7a2b7c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.584629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-35588fc4-e511-4a02-99a8-a7bb6fb0c694 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737107 Sep 13 19:54:13.594022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 237/476] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 19:54:13.599717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7465e757-ff8b-47c9-8944-cdef449221b3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:13.599979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7465e757-ff8b-47c9-8944-cdef449221b3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:13.601616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-d44550fe-4c9b-4f28-984f-9e206355cdf1 req-2ca9f14e-7f72-4c52-b227-8bd30e7a2b7c service nova] Creating event network-vif-plugged:0a8426a0-9e45-4b77-aa52-3f03d1426e6c for instance 2129723c-9cf0-42d5-81be-81547f40b36b on hv-cinder-82880 Sep 13 19:54:13.611923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-d44550fe-4c9b-4f28-984f-9e206355cdf1 req-2ca9f14e-7f72-4c52-b227-8bd30e7a2b7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064874 Sep 13 19:54:13.614183 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 240/477] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:13.675213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7465e757-ff8b-47c9-8944-cdef449221b3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:13.683167 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7465e757-ff8b-47c9-8944-cdef449221b3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1218 microversion: 2.1 time: 0.087740 Sep 13 19:54:13.684092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 238/478] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:13 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:13.948804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:13.950283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:13.957690 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.958395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.958832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.959503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.960145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.960972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:13.978520 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2a82862b-bdf4-4f3f-8028-4ceeaccb3e50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:13.987415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2a82862b-bdf4-4f3f-8028-4ceeaccb3e50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:13.988276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2a82862b-bdf4-4f3f-8028-4ceeaccb3e50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:13.989297 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2a82862b-bdf4-4f3f-8028-4ceeaccb3e50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.039734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2a82862b-bdf4-4f3f-8028-4ceeaccb3e50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Going to try to stop instance {{(pid=132127) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 19:54:14.099271 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2a82862b-bdf4-4f3f-8028-4ceeaccb3e50 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action" status: 202 len: 0 microversion: 2.1 time: 0.124129 Sep 13 19:54:14.100119 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 239/479] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:54:13 2022] POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 19:54:14.114179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:14.115807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:14.126860 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.127499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.128280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.129643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.130677 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.131689 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.176793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.186646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dc196388-b704-4e9b-8629-bbe69f286831 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.243241 Sep 13 19:54:14.188305 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 241/480] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:13 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:14.299938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:14.300712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:14.307076 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.307594 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.308078 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.308773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.309377 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.309685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.397646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.406759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7ad0c729-4a38-44e4-ae54-fa21adcff787 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.301167 Sep 13 19:54:14.407388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 240/481] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:14 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:14.476153 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.484949 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-991bb90a-9404-4e30-99b8-936f663b3f96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.189065 Sep 13 19:54:14.485552 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 242/482] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:14 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:14.534626 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:14.535345 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:14.541833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.542311 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.542737 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.543426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.543872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.544291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.708596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:14.710422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:14.724279 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.725134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.725583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.729685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:14.731974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:14.732589 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:14.744408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.756666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.758351 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.759482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-87e6284d-cdba-4585-84b5-dafe33811672 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1809 microversion: 2.20 time: 0.228891 Sep 13 19:54:14.760393 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 241/483] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:14 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:14.810871 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:14.820086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fd98c11c-2e69-4c29-bc99-188445c38345 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1270 microversion: 2.1 time: 0.116635 Sep 13 19:54:14.820781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 243/484] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:14 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:15.217762 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:15.218345 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:15.225584 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.226056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.226487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.227216 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.227655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.228068 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.431320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:15.432680 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:15.435900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.442664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.443163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.443593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.444300 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.445264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.445386 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.445866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6c10b09b-2af5-4446-aa36-161270a46cdb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.231981 Sep 13 19:54:15.446724 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 242/485] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:15 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:15.509104 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:15.509764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:15.515969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.516453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.516879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.517609 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.518052 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.518464 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.621227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.630200 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-452303b0-1057-4e15-890d-6959adf99e24 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.203479 Sep 13 19:54:15.630766 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 244/486] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:15 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:15.669903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.679474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d3720483-beef-4b28-b551-52d7c58bb483 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.174227 Sep 13 19:54:15.680057 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 243/487] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:15 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:15.787513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:15.796772 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:15.804067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.804587 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.805052 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.805787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.806678 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.806678 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.843758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:15.844368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:15.850810 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.851290 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.851717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.852409 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:15.852855 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:15.853292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:15.932980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.941126 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0b00b54a-16d7-48e7-9142-55960d65c8cb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1270 microversion: 2.1 time: 0.101188 Sep 13 19:54:15.941720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 244/488] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:15 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:15.970343 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.973088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:15.980980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.982374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:15.983547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d97a2e6e-06e3-4ab6-a6be-e53c8a83db9d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1796 microversion: 2.20 time: 0.202312 Sep 13 19:54:15.984098 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 245/489] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:54:15 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1796 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:54:16.469507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:16.470161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:16.476826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.477336 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.477764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.478461 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.478906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.479294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.619024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:16.627511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2e27ddec-f343-4d92-a3e8-89facc361513 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1358 microversion: 2.1 time: 0.161877 Sep 13 19:54:16.628101 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 245/490] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:16 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:16.654342 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:16.654945 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:16.663288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.663764 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.664172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.664860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.665331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.665748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.703233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:16.703844 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:16.705842 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:16.712059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.712484 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.712979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.713714 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.714174 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.714594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.859617 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:16.867478 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-89ea7258-3cc1-4c14-9e82-03b9ee324a16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.216990 Sep 13 19:54:16.868057 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 246/491] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:16 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:16.886179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:16.894845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8956377c-44ce-43d7-ac40-c628b847afd4 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.195526 Sep 13 19:54:16.895416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 246/492] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:16 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:16.964230 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:16.964832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:16.971555 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.972030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.972604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:16.973345 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:16.973797 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:16.974224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.037320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:17.045846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7ea2d28b-9fe8-4dfb-a211-806712d7097f tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1270 microversion: 2.1 time: 0.085495 Sep 13 19:54:17.046430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 247/493] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:16 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:17.650328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:17.650958 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:17.657871 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.658348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.658783 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.659468 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.660040 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.660653 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.797015 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:17.805047 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e2fae2b5-cf49-4ae2-a3ae-737b67067baa tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1548 microversion: 2.1 time: 0.158552 Sep 13 19:54:17.805708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 247/494] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:17 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:17.827792 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:17.828343 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:17.835169 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.835655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.836083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.836979 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.837429 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.837844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.891613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:17.892254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:17.898706 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.899235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.899662 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:17.900425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:17.900804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:17.901266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.105823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:18.114296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dc64c891-721f-47b7-adf3-fe2b1a1a65cc tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1548 microversion: 2.1 time: 0.290290 Sep 13 19:54:18.114944 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 248/495] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:17 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1548 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:18.136645 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:18.137303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:18.143281 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.143760 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.144274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.145001 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.145456 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.145873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.154413 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:18.163504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0b848872-208b-4711-941f-404a4155dc30 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.275801 Sep 13 19:54:18.165321 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 248/496] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:17 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:18.169191 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:18.169769 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:18.176203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.176660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.177131 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.177891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.178342 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.178756 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.254454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:18.263045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d45cb732-dffd-44c7-9bdd-d624f3b9712a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1288 microversion: 2.1 time: 0.097930 Sep 13 19:54:18.263841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 249/497] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:18 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:18.268258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:18.274142 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:18.274919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Searching by: {'deleted': False, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23'} {{(pid=132127) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 19:54:18.282116 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.282594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.283022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.283765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.284216 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.284790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.378984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.multi_cell_list [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132127) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 19:54:18.403183 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:18.415029 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-37a95984-8342-4f86-882c-9f4b6749927f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.284682 Sep 13 19:54:18.415819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 249/498] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:18 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:18.476165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-455537bf-a047-4a79-9bac-aa8126788aea tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211454 Sep 13 19:54:18.477100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 250/499] 10.222.0.18 () {58 vars in 1125 bytes} [Tue Sep 13 19:54:18 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:18.489609 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:18.490395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:18.498354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.498769 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.499277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.500035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:18.500668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:18.502446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:18.722879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:18.734276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1785ee72-50d6-40e7-abaa-ea92569ad036 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1548 microversion: 2.1 time: 0.248689 Sep 13 19:54:18.753293 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 250/500] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:18 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1548 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:19.187845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:19.188385 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:19.195516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.196032 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.196486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.197218 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.197666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.198087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.287094 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:19.287727 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:19.294774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.295262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.295688 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.296382 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.296836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.297309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.459588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:19.467999 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-20f452d3-adc1-4135-87af-c0e0dfe49e02 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.284124 Sep 13 19:54:19.468560 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 251/501] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:19 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:19.473240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:19.473845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:19.480607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.480607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.481062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.481478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:19.481937 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:19.482413 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:19.595354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:19.603799 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7a8b03ab-4c5c-4b15-8575-5f41c092d5d3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1318 microversion: 2.1 time: 0.320917 Sep 13 19:54:19.604547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 251/502] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:19 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:19.744013 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:19.755608 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-acf1286e-4855-4b22-8b99-1b17b9be2e1b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.285809 Sep 13 19:54:19.766462 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 252/503] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:19 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:20.137384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-77ceeda8-d4cc-4e1b-a352-eaa15bd18194 req-c67a77f3-1138-41c5-9437-7c533a483b5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c92928-bce2-4552-abd2-df43763a0f51", "tag": "e1648ad3-f564-471a-8f55-e14ff6446ed9"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:20.148506 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-77ceeda8-d4cc-4e1b-a352-eaa15bd18194 req-c67a77f3-1138-41c5-9437-7c533a483b5e service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.149319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-77ceeda8-d4cc-4e1b-a352-eaa15bd18194 req-c67a77f3-1138-41c5-9437-7c533a483b5e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.149891 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-77ceeda8-d4cc-4e1b-a352-eaa15bd18194 req-c67a77f3-1138-41c5-9437-7c533a483b5e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.163450 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-77ceeda8-d4cc-4e1b-a352-eaa15bd18194 req-c67a77f3-1138-41c5-9437-7c533a483b5e service nova] Creating event network-changed:e1648ad3-f564-471a-8f55-e14ff6446ed9 for instance 08c92928-bce2-4552-abd2-df43763a0f51 on hv-cinder-82880 Sep 13 19:54:20.172130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-77ceeda8-d4cc-4e1b-a352-eaa15bd18194 req-c67a77f3-1138-41c5-9437-7c533a483b5e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039258 Sep 13 19:54:20.173445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 252/504] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:20.381244 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20410e85-5b5d-4584-a9d8-0dc39f69aef1"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:20.383596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:20.390539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.391033 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.391463 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.392165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.392616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.393069 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.397265 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:20.493928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:20.494953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:20.502718 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.503251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.503897 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.504703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.505288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.505778 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.696822 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2677de32-9883-455e-8c00-f20a5e713c26 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319448 Sep 13 19:54:20.697463 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 253/505] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:54:20 2022] POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:20.703431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:20.704204 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:20.711399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.711887 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.712320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:20.713085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:20.713536 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:20.713952 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:21.022189 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:21.031126 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c17eabda-1b6a-4f65-a39d-a7e1d1672ced tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.542228 Sep 13 19:54:21.037292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 253/506] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:20 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:21.038289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:21.039332 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:21.046664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:21.047986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:21.048405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:21.049155 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:21.049614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:21.050018 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:21.073190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:21.081161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-69a6aa3d-4122-4c97-bc6c-b34c45f08d52 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1318 microversion: 2.1 time: 0.382467 Sep 13 19:54:21.082139 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 254/507] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:20 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:21.186892 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:21.195607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d4dd41a7-d3a8-4647-ae16-52c01e4827e1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.162096 Sep 13 19:54:21.196190 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 254/508] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:21 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:22.055255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:22.055811 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:22.062961 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.063449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.063877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.064612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.065108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.065516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.104383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:22.105038 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:22.112777 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.113491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.114097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.115210 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.115844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.116501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.285768 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:22.294501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-11eba575-12d5-4100-bdf7-a1a596635bce tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.243044 Sep 13 19:54:22.295093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 255/509] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:22 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:22.315181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:22.315800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:22.322143 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.322620 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.323058 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.323762 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:22.324210 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:22.324633 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:22.340684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:22.349681 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-52b97f60-9acb-4d63-a81c-ad468381cb6a tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1318 microversion: 2.1 time: 0.249003 Sep 13 19:54:22.350241 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 255/510] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:22 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:22.522617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:22.532403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-07667f55-03b8-409b-950e-b896fe56e487 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.222059 Sep 13 19:54:22.533094 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 256/511] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:22 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:23.322556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:23.323206 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:23.330755 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.331252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.331817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.332532 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.333026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.333453 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.373275 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:23.373856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:23.380979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.381470 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.381899 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.382597 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.383042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.383465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.523974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:23.535229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-988c6cd5-4e20-4ba9-92a4-153ad3b26181 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.216519 Sep 13 19:54:23.545192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 256/512] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:23 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:23.556707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:23.557695 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:23.562615 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:23.565101 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.565687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.566243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.567030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:23.567740 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:23.568223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:23.574599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-fb11e518-dda7-4ba6-a3ef-41571d7da273 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1318 microversion: 2.1 time: 0.205066 Sep 13 19:54:23.576937 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 257/513] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:23 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:54:23.710405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:23.718823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2150b9be-abb8-44e3-89a0-cefb2d561bc3 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.166758 Sep 13 19:54:23.719442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 257/514] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:23 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:24.563185 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:24.563778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:24.565766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=8 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:24.571932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.572421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.572839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.573564 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.574004 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.574418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.599024 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:24.600684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:24.610616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.611370 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.611992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.613026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.613673 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.614336 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.779959 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:24.788342 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f80fa610-47c3-411c-b7ec-43d00893726d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1676 microversion: 2.1 time: 0.229105 Sep 13 19:54:24.788954 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 258/515] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:24 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:24.793591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:24.794196 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:24.800190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.800729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.801383 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.802087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:24.802535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:24.802953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:24.808430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:24.816385 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-99d99d84-23a4-45f5-978f-a7e2b66a0eb6 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1318 microversion: 2.1 time: 0.222225 Sep 13 19:54:24.816988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 258/516] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:24 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:24.940735 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:24.949660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4d06c6e5-9b61-4338-b9bb-9ff162f0fd92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.159653 Sep 13 19:54:24.950246 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 259/517] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:24 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:25.582490 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-89c95e80-7e3b-4b4b-844b-35bbc4dc0626 req-c9d11993-5512-4c17-b27f-f998b1da940a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c92928-bce2-4552-abd2-df43763a0f51", "name": "network-vif-plugged", "status": "completed", "tag": "e1648ad3-f564-471a-8f55-e14ff6446ed9"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:25.592548 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-89c95e80-7e3b-4b4b-844b-35bbc4dc0626 req-c9d11993-5512-4c17-b27f-f998b1da940a service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:25.593103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-89c95e80-7e3b-4b4b-844b-35bbc4dc0626 req-c9d11993-5512-4c17-b27f-f998b1da940a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:25.593539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-89c95e80-7e3b-4b4b-844b-35bbc4dc0626 req-c9d11993-5512-4c17-b27f-f998b1da940a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:25.606956 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-89c95e80-7e3b-4b4b-844b-35bbc4dc0626 req-c9d11993-5512-4c17-b27f-f998b1da940a service nova] Creating event network-vif-plugged:e1648ad3-f564-471a-8f55-e14ff6446ed9 for instance 08c92928-bce2-4552-abd2-df43763a0f51 on hv-cinder-82880 Sep 13 19:54:25.611958 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-89c95e80-7e3b-4b4b-844b-35bbc4dc0626 req-c9d11993-5512-4c17-b27f-f998b1da940a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033616 Sep 13 19:54:25.612806 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 259/518] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:25.812018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:25.813370 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:25.820630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:25.821150 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:25.821575 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:25.822278 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:25.822731 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:25.823183 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:25.840400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:25.842045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:25.848498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:25.849006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:25.849437 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:25.850209 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:25.850570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:25.850982 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.049784 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:26.058295 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8156b5e2-3a9d-4d40-8e83-32b4bed3cd70 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1653 microversion: 2.1 time: 0.250265 Sep 13 19:54:26.059334 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 260/519] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:25 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1653 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:26.073987 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:26.077080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:26.077704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:26.083750 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2b52c7e5-ceb3-4d9e-ac48-62b2a53a3338 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1318 microversion: 2.1 time: 0.247714 Sep 13 19:54:26.084664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 260/520] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:25 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:26.084751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.088984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.088984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.088984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.088984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.089378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.089460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-95d7eace-c566-4408-a454-882e6ada0b89 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:26.095547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95d7eace-c566-4408-a454-882e6ada0b89 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.096022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95d7eace-c566-4408-a454-882e6ada0b89 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.096469 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-95d7eace-c566-4408-a454-882e6ada0b89 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.119278 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-95d7eace-c566-4408-a454-882e6ada0b89 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Going to try to start instance {{(pid=132128) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 19:54:26.162482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-95d7eace-c566-4408-a454-882e6ada0b89 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action" status: 202 len: 0 microversion: 2.1 time: 0.076629 Sep 13 19:54:26.163091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 261/521] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:54:26 2022] POST /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:54:26.173999 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:26.174693 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:26.183252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.183880 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.184336 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.185216 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:26.185968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:26.186472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:26.239199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:26.248118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b6522210-b67e-49f9-a306-67a94e19a357 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.187741 Sep 13 19:54:26.249412 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 261/522] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:26 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:26.331933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:26.334362 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:26.341525 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5ba95cf2-12e6-4244-a6ea-488aa3434ccb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1662 microversion: 2.1 time: 0.171711 Sep 13 19:54:26.342093 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 262/523] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:26 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:27.109963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:27.110496 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:27.118226 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.118720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.119156 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.119864 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.120304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.120739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.255016 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:27.263033 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-da323091-299e-4eb5-a121-d54217506edb tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1318 microversion: 2.1 time: 0.156958 Sep 13 19:54:27.263642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 262/524] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:27 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:27.271463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:27.272074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:27.279724 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.280211 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.280647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.281383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.281844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.282269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.365012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:27.365657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:27.372102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.372612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.373105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.373791 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:27.374237 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:27.374652 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:27.426181 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:27.434946 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d284bae9-c020-41cc-9835-86c7ab0366e9 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.167437 Sep 13 19:54:27.435536 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 263/525] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:27 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:27.511533 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:27.519476 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-69f26fbe-a312-4a8d-ab04-0f96dc9590d5 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1662 microversion: 2.1 time: 0.158397 Sep 13 19:54:27.520048 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 263/526] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:27 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:28.287654 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:28.288272 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:28.295276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.295758 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.296218 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.296920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.297402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.297831 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.458850 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:28.459546 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:28.462261 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=4 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:28.468053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.468545 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.469001 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.469732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.470166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.470599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.488269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:28.496227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0ecb96ca-8991-4328-b4a8-b63da9ef7783 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1508 microversion: 2.1 time: 0.213285 Sep 13 19:54:28.496802 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 264/527] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:28 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:28.520028 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee1300f9-c30f-45df-83f3-18c00231efca", "device": "/dev/sdb"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:28.522523 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:28.529019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.529520 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.529928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.530621 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.531066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.531482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.608619 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:28.617499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-21794e8e-abf4-470f-8a5e-d8ba6c995aa5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.162619 Sep 13 19:54:28.618097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 264/528] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:28 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:28.622729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:28.623420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:28.629583 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.630068 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.630501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.631178 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:28.631661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:28.632071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:28.768808 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:28.776976 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a7b0b4c3-4205-4870-bc03-29f478ac4a55 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1662 microversion: 2.1 time: 0.157871 Sep 13 19:54:28.777552 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 265/529] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:28 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1662 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:29.013667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b72a2f4e-a16f-472c-aa20-464c19f615ee tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "POST /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.498185 Sep 13 19:54:29.018682 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 265/530] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:54:28 2022] POST /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51/os-volume_attachments => generated 194 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:29.407659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:29.408265 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:29.414865 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.415341 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.415765 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.416438 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.416879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.417321 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.585385 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:29.593902 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e8ecd5f5-ba37-471c-9b84-c266ad729dd8 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1594 microversion: 2.1 time: 0.190086 Sep 13 19:54:29.594510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 266/531] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:29 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1594 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:29.641784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:29.642473 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:29.649321 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.649805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.650230 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.650924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.651367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.651781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.801274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:29.801956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:29.808623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.809317 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.809746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.810444 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:29.810891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:29.811307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:29.844483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:29.853990 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-898c24f0-e5b7-48ca-9b82-a279b8b242aa tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.216947 Sep 13 19:54:29.865045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 266/532] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:29 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:29.949740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:29.958067 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ef7840da-12e7-4e49-ab5b-649c51329e4d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1666 microversion: 2.1 time: 0.160872 Sep 13 19:54:29.958646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 267/533] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:29 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1666 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:30.878960 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:30.879787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:30.886893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.887374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.887807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:30.888513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:30.888999 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:30.889438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:31.023655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:31.032813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-acb979c9-0324-48b9-8f99-cc2bd2c6d138 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.157766 Sep 13 19:54:31.033442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 267/534] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:30 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:31.593465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-bc4029df-3864-4aab-923c-26a30c2ff9f9 req-f50f2a32-8786-4238-8d5e-5d327a55007e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2129723c-9cf0-42d5-81be-81547f40b36b", "tag": "0a8426a0-9e45-4b77-aa52-3f03d1426e6c"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:31.608527 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bc4029df-3864-4aab-923c-26a30c2ff9f9 req-f50f2a32-8786-4238-8d5e-5d327a55007e service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:31.609439 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bc4029df-3864-4aab-923c-26a30c2ff9f9 req-f50f2a32-8786-4238-8d5e-5d327a55007e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:31.610059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bc4029df-3864-4aab-923c-26a30c2ff9f9 req-f50f2a32-8786-4238-8d5e-5d327a55007e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:31.622452 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-bc4029df-3864-4aab-923c-26a30c2ff9f9 req-f50f2a32-8786-4238-8d5e-5d327a55007e service nova] Creating event network-changed:0a8426a0-9e45-4b77-aa52-3f03d1426e6c for instance 2129723c-9cf0-42d5-81be-81547f40b36b on hv-cinder-82880 Sep 13 19:54:31.627943 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-bc4029df-3864-4aab-923c-26a30c2ff9f9 req-f50f2a32-8786-4238-8d5e-5d327a55007e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038532 Sep 13 19:54:31.628594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 268/535] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:32.059322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:32.060306 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:32.068231 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.069241 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.069920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.070980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.071709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.072382 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.256192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:32.269195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a9d25f0a-4798-4897-8a5f-c37282318c79 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.216494 Sep 13 19:54:32.269991 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 268/536] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:32 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:32.815892 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-533328591"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:32.816602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:32.822941 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.823420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.823847 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.824588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:32.825003 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:32.825414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:32.827891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:32.964526 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.network.security_group_api [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Adding security group 9b4b0147-a14c-478d-add9-0f8ecc3d735f to port 0a8426a0-9e45-4b77-aa52-3f03d1426e6c Sep 13 19:54:33.300476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:33.301195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:33.317559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.318045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.318476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.319180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.325175 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.325514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.327097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c0cb76b4-5f36-4734-a40f-9e7287a3d0eb tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/action" status: 202 len: 0 microversion: 2.1 time: 0.516121 Sep 13 19:54:33.327929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 269/537] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:54:32 2022] POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:54:33.336283 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:33.337191 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:33.344704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.345670 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.346346 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.347874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.348549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.349184 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.595866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:33.605468 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2026eeac-faa3-4aca-a241-123d7f226c03 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.313990 Sep 13 19:54:33.606145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 269/538] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:33 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:33.611129 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-d82b3b8a-c721-44ca-a012-4ece00fc1fa6 req-711d4d33-c156-4361-add0-ad2d05b61ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2129723c-9cf0-42d5-81be-81547f40b36b", "tag": "0a8426a0-9e45-4b77-aa52-3f03d1426e6c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:33.620712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d82b3b8a-c721-44ca-a012-4ece00fc1fa6 req-711d4d33-c156-4361-add0-ad2d05b61ea2 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:33.621561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d82b3b8a-c721-44ca-a012-4ece00fc1fa6 req-711d4d33-c156-4361-add0-ad2d05b61ea2 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:33.622162 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d82b3b8a-c721-44ca-a012-4ece00fc1fa6 req-711d4d33-c156-4361-add0-ad2d05b61ea2 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:33.634497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-d82b3b8a-c721-44ca-a012-4ece00fc1fa6 req-711d4d33-c156-4361-add0-ad2d05b61ea2 service nova] Creating event network-changed:0a8426a0-9e45-4b77-aa52-3f03d1426e6c for instance 2129723c-9cf0-42d5-81be-81547f40b36b on hv-cinder-82880 Sep 13 19:54:33.640037 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-d82b3b8a-c721-44ca-a012-4ece00fc1fa6 req-711d4d33-c156-4361-add0-ad2d05b61ea2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032396 Sep 13 19:54:33.640917 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 270/539] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:33.655648 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:33.665637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a45e5a70-467b-4463-a51f-fec84e203dc0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1640 microversion: 2.1 time: 0.333315 Sep 13 19:54:33.666328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 270/540] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:33 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1640 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:34.631118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:34.631860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:34.638909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:34.639499 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:34.639938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:34.640640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:34.641319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:34.641752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:34.818552 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:34.827853 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8aeee8a0-01ea-4018-8d91-eef0c1319ccd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1735 microversion: 2.1 time: 0.202345 Sep 13 19:54:34.828443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 271/541] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:34 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:35.851227 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:35.852019 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:35.860173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:35.860807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:35.861336 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:35.862129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:35.862651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:35.863061 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.007525 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:36.015977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e79d87a1-520c-4df3-bf79-1acbae11c09f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1715 microversion: 2.1 time: 0.169084 Sep 13 19:54:36.016577 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 271/542] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:35 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:36.137252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:36.137784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:36.144780 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.145333 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.145777 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.146676 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.147116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.147531 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.279739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] HTTP exception thrown: Cannot 'detach_volume' instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 while it is in vm_state rescued Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Request method failure captured: Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments/9c074390-f63f-4c9a-8ea5-f22927d1f939 HTTP/1.1 Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN8IWZVJgTK_kjohabZObSZmELvZaDYYGCq3h-A34bxLqZoZkgP85o1Gt98TSagy5HnN8qGNGzQn_eURe1G2bJBqGGcHCeIqeO8bSFjNXLsHvrDf5ud3D2UAtAUx88bIL6KX0KOrwThqmAurXBcKPff8h0V10QBkuMp21KERvcQ5k-4 Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:54:36.281391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_592bbccef3ef42ccbc7e2c3dc5bb86de", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}] Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: a1c9d4af0a98406692e1d79293844c68 Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:54:36.283061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Cannot 'detach_volume' instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 while it is in vm_state rescued Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'server_id': 'a9b1b8b5-f84c-4ba9-9bf9-75535a05af91', 'id': '9c074390-f63f-4c9a-8ea5-f22927d1f939'} Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:54:36.283865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 while it is in vm_state rescued Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 while it is in vm_state rescued Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:54:36.285448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Returning 409 to user: Cannot 'detach_volume' instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 while it is in vm_state rescued {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:54:36.286971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c845eefb-4027-4ece-99e3-46df3b8f16ac tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments/9c074390-f63f-4c9a-8ea5-f22927d1f939" status: 409 len: 152 microversion: 2.1 time: 0.150114 Sep 13 19:54:36.286971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 272/543] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:54:36 2022] DELETE /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments/9c074390-f63f-4c9a-8ea5-f22927d1f939 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 19:54:36.292726 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:36.293287 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:36.299646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.300128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.300546 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.301271 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.301720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.302124 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.379730 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-709e0832-656a-48dc-a532-db03fc24b47b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "POST /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/action" status: 202 len: 0 microversion: 2.1 time: 0.090747 Sep 13 19:54:36.380270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 272/544] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:54:36 2022] POST /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:54:36.388831 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:36.389511 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:36.399383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.400229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.401089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.402419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:36.403382 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:36.404075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:36.559667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:36.568653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-114622c6-a065-4334-8061-012c4fc477bb tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.183966 Sep 13 19:54:36.569508 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 273/545] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:36 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:37.593668 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:37.594366 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:37.601055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:37.601532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:37.601961 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:37.602694 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:37.603168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:37.603607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:37.744471 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:37.752991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1a28b54b-d6fa-4792-81a1-62f6f0798131 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.164096 Sep 13 19:54:37.753855 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 273/546] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:37 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:38.780323 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:38.781009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:38.789825 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:38.790317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:38.790738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:38.791426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:38.791867 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:38.792280 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:38.928600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:38.937034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fc6b1718-b722-4dfd-90f4-ae0dfbdaa1bf tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.161846 Sep 13 19:54:38.937640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 274/547] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:38 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:39.961574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:39.962094 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:39.968927 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:39.969411 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:39.969850 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:39.970572 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:39.971004 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:39.971423 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:40.104158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:40.113015 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f05d425a-d7e0-4e5d-99aa-f7330d80e037 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.156024 Sep 13 19:54:40.113588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 274/548] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:39 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:41.136470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:41.137108 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:41.139615 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=80 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:41.145133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:41.145624 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:41.146042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:41.146736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:41.147185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:41.147595 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:41.290004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:41.299315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6909bc25-c742-419b-9e8a-5eabee18f239 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.166690 Sep 13 19:54:41.299917 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 275/549] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:41 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:42.322862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:42.323517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:42.330223 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:42.330733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:42.331194 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:42.331960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:42.332405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:42.332822 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:42.466922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:42.475700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-102dfb5c-270c-4708-8ac8-967061bc2336 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.156742 Sep 13 19:54:42.476273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 275/550] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:42 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:43.499764 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:43.500767 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:43.510896 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:43.511692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:43.512405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:43.513647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:43.514387 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:43.515128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:43.657171 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:43.666275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f1fd761f-9a98-4e1b-8f78-896916c47a57 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.171122 Sep 13 19:54:43.666846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 276/551] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:43 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:44.691840 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:44.692458 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:44.699144 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:44.699627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:44.700058 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:44.700744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:44.701296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:44.701710 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:44.848608 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:44.857383 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f1aff739-8d85-4d56-8bbe-ffe6998cee92 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.169899 Sep 13 19:54:44.857958 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 276/552] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:44 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:45.881363 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:45.882139 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:45.889488 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:45.889987 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:45.890427 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:45.891142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:45.891586 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:45.892032 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:46.037561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:46.046104 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-918dc3cb-6b00-4bd6-ba12-afa48067626a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1723 microversion: 2.1 time: 0.168942 Sep 13 19:54:46.046672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 277/553] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:45 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:47.070066 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:47.070684 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:47.073246 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=62 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:47.078773 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.079259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.079693 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:47.080394 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.080844 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.081302 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:47.219843 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:47.228385 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f4f584ec-4311-404e-95f8-fe1498868f53 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1729 microversion: 2.1 time: 0.162470 Sep 13 19:54:47.229129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 277/554] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:47 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:47.250879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:47.251505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:47.258177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.258684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.259109 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:47.259790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:47.260229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:47.260640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:47.344653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-22530260-4221-48ac-b7b6-f84bef82cb3f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097664 Sep 13 19:54:47.345311 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 278/555] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 19:54:47 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:48.259939 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-e9ad4a63-6984-426d-b3d4-4bad64dfd4b6 req-00abe40b-92d6-4ae2-bee0-d90df8ace730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b1b8b5-f84c-4ba9-9bf9-75535a05af91", "tag": "b09f2e8a-de1a-4977-93b0-5ea0ae7926e1"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:48.270151 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-e9ad4a63-6984-426d-b3d4-4bad64dfd4b6 req-00abe40b-92d6-4ae2-bee0-d90df8ace730 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:48.270847 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-e9ad4a63-6984-426d-b3d4-4bad64dfd4b6 req-00abe40b-92d6-4ae2-bee0-d90df8ace730 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:48.271357 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-e9ad4a63-6984-426d-b3d4-4bad64dfd4b6 req-00abe40b-92d6-4ae2-bee0-d90df8ace730 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:48.282929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-e9ad4a63-6984-426d-b3d4-4bad64dfd4b6 req-00abe40b-92d6-4ae2-bee0-d90df8ace730 service nova] Creating event network-changed:b09f2e8a-de1a-4977-93b0-5ea0ae7926e1 for instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 on hv-cinder-82880 Sep 13 19:54:48.289370 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-e9ad4a63-6984-426d-b3d4-4bad64dfd4b6 req-00abe40b-92d6-4ae2-bee0-d90df8ace730 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033197 Sep 13 19:54:48.290041 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 278/556] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:49.672717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:49.673363 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:49.681017 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:49.681513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:49.681953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:49.682670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:49.683126 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:49.683553 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:49.686471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:49.774734 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lazy-loading 'services' on Instance uuid 08c92928-bce2-4552-abd2-df43763a0f51 {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:54:49.896376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-860eb58f-35f1-43b9-9af7-8b748ae024ca tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51/os-volume_attachments/ee1300f9-c30f-45df-83f3-18c00231efca" status: 202 len: 0 microversion: 2.1 time: 0.229953 Sep 13 19:54:49.896945 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 279/557] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:54:49 2022] DELETE /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51/os-volume_attachments/ee1300f9-c30f-45df-83f3-18c00231efca => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:54:50.305417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-e4b03324-bc62-4bbb-9c00-0902da5e5a3e req-285a04e3-7798-41cb-a3ba-79b81ef73010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9b1b8b5-f84c-4ba9-9bf9-75535a05af91", "tag": "b09f2e8a-de1a-4977-93b0-5ea0ae7926e1"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:50.315659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-e4b03324-bc62-4bbb-9c00-0902da5e5a3e req-285a04e3-7798-41cb-a3ba-79b81ef73010 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:50.316133 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-e4b03324-bc62-4bbb-9c00-0902da5e5a3e req-285a04e3-7798-41cb-a3ba-79b81ef73010 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:50.316588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-e4b03324-bc62-4bbb-9c00-0902da5e5a3e req-285a04e3-7798-41cb-a3ba-79b81ef73010 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:50.327683 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-e4b03324-bc62-4bbb-9c00-0902da5e5a3e req-285a04e3-7798-41cb-a3ba-79b81ef73010 service nova] Creating event network-changed:b09f2e8a-de1a-4977-93b0-5ea0ae7926e1 for instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 on hv-cinder-82880 Sep 13 19:54:50.332782 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-e4b03324-bc62-4bbb-9c00-0902da5e5a3e req-285a04e3-7798-41cb-a3ba-79b81ef73010 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032055 Sep 13 19:54:50.333353 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 279/558] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:52.094408 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:52.095001 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:52.102434 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.102919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.103344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.104038 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.104473 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.104911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.130998 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:54:52.214466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-62c673cf-d8ae-4832-b705-c876192aeae2 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "DELETE /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 204 len: 0 microversion: 2.1 time: 0.127512 Sep 13 19:54:52.215168 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 280/559] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:54:52 2022] DELETE /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:54:52.229752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:52.230527 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:52.236861 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.237370 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.237810 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.238497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:52.238926 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:52.239337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:52.379623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:52.391076 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a2c5d483-51ab-4423-afd1-4f7efb675867 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1514 microversion: 2.1 time: 0.170104 Sep 13 19:54:52.391881 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 280/560] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:52 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:53.420330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:53.421257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:53.430098 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:53.430595 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:53.431019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:53.431710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:53.432159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:53.432576 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:53.576596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:53.584488 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9aefa0a1-efdf-4c76-88fa-6c78a05a0c53 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1514 microversion: 2.1 time: 0.170823 Sep 13 19:54:53.585075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 281/561] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:53 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:54.607975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:54.608611 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:54.615455 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:54.615938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:54.616389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:54.617117 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:54.617562 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:54.617981 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:54.751525 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c76c57183e406c87f434841fc13b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa70232219304082b5ee608a7ea61c22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:54:54.759516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-31da9850-c7df-43b6-8ea0-468e0045efb0 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 200 len: 1514 microversion: 2.1 time: 0.155479 Sep 13 19:54:54.760300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 281/562] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:54 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:54:54.880739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-bfb5d6ae-8120-4d4d-8e54-f7d165b66917 req-89e720b2-9900-489e-a9fa-f10388a9d7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c92928-bce2-4552-abd2-df43763a0f51", "name": "network-vif-deleted", "tag": "e1648ad3-f564-471a-8f55-e14ff6446ed9"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:54:54.891023 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-bfb5d6ae-8120-4d4d-8e54-f7d165b66917 req-89e720b2-9900-489e-a9fa-f10388a9d7f8 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:54.891490 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-bfb5d6ae-8120-4d4d-8e54-f7d165b66917 req-89e720b2-9900-489e-a9fa-f10388a9d7f8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:54.891903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-bfb5d6ae-8120-4d4d-8e54-f7d165b66917 req-89e720b2-9900-489e-a9fa-f10388a9d7f8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:54.903199 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-bfb5d6ae-8120-4d4d-8e54-f7d165b66917 req-89e720b2-9900-489e-a9fa-f10388a9d7f8 service nova] Creating event network-vif-deleted:e1648ad3-f564-471a-8f55-e14ff6446ed9 for instance 08c92928-bce2-4552-abd2-df43763a0f51 on hv-cinder-82880 Sep 13 19:54:54.908002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-bfb5d6ae-8120-4d4d-8e54-f7d165b66917 req-89e720b2-9900-489e-a9fa-f10388a9d7f8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031010 Sep 13 19:54:54.908599 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 282/563] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:54:55.782482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:54:55.783098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] [instance: 08c92928-bce2-4552-abd2-df43763a0f51] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:54:55.790242 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:55.790754 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:55.791184 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:55.791883 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:54:55.792332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:54:55.792752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:54:55.806468 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] HTTP exception thrown: Instance 08c92928-bce2-4552-abd2-df43763a0f51 could not be found. Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Request method failure captured: Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 HTTP/1.1 Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN9-fJTnM8_oELCO6Qs-OPRiI6IZxGUUnfU55jeqYSlF4ZHNjrsAPLlAmcQ93CyqYi-zDmMI2FoOKp4xUZgFGEOdkJDaLCQLeoJjGks9RmgaNBKcqSMP42ONdp7KJsTcq4nF9j_JEnwRBQBIRI7Ygk_PZsS21IBvAnRM79WK72rWbvc Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: fa70232219304082b5ee608a7ea61c22 Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1598337191 Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:54:55.808243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa70232219304082b5ee608a7ea61c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fa70232219304082b5ee608a7ea61c22", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fa70232219304082b5ee608a7ea61c22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fa70232219304082b5ee608a7ea61c22"}]}] Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-VolumesSnapshotTestJSON-1598337191 Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: fa70232219304082b5ee608a7ea61c22 Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1598337191 Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-VolumesSnapshotTestJSON-1598337191-project Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 11c76c57183e406c87f434841fc13b43 Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-VolumesSnapshotTestJSON-1598337191-project Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 08c92928-bce2-4552-abd2-df43763a0f51 could not be found. Sep 13 19:54:55.809613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '08c92928-bce2-4552-abd2-df43763a0f51'} Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c92928-bce2-4552-abd2-df43763a0f51 could not be found. Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:54:55.810596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c92928-bce2-4552-abd2-df43763a0f51 could not be found. Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c92928-bce2-4552-abd2-df43763a0f51 could not be found. Sep 13 19:54:55.812100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:54:55.813343 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] Returning 404 to user: Instance 08c92928-bce2-4552-abd2-df43763a0f51 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:54:55.813343 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0d586a3f-9963-495a-9f8a-2e17bad608e3 tempest-VolumesSnapshotTestJSON-1598337191 tempest-VolumesSnapshotTestJSON-1598337191-project] 10.222.0.18 "GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51" status: 404 len: 111 microversion: 2.1 time: 0.031634 Sep 13 19:54:55.813343 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 282/564] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:54:55 2022] GET /compute/v2.1/servers/08c92928-bce2-4552-abd2-df43763a0f51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:55:05.004263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:05.004921 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:05.009768 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:05.010370 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:05.018819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.019347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.019785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.020524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.021010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.021436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.055395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-812ce6f2-5d49-4554-9a01-f9a4299c040a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments/463c91be-565c-46c7-a9ed-a5a3b834ee19" status: 200 len: 194 microversion: 2.20 time: 0.052805 Sep 13 19:55:05.056008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 283/565] 10.222.0.18 () {60 vars in 1454 bytes} [Tue Sep 13 19:55:05 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments/463c91be-565c-46c7-a9ed-a5a3b834ee19 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:55:05.138517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:05.139128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:05.145305 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.145820 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.146247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.146940 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.147384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.147804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.150492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:05.234307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lazy-loading 'services' on Instance uuid 9fc2f361-c297-4a69-9898-d4d3cc310118 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:05.313688 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e70c91f2-c21a-447a-92e5-61037496af99 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments/463c91be-565c-46c7-a9ed-a5a3b834ee19" status: 202 len: 0 microversion: 2.20 time: 0.179933 Sep 13 19:55:05.314395 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 283/566] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Sep 13 19:55:05 2022] DELETE /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments/463c91be-565c-46c7-a9ed-a5a3b834ee19 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:55:05.323799 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:05.325947 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:05.332214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.332734 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.333251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.334007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:05.334449 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:05.334844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:05.368245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7365c30c-9995-453d-8819-2a13282a0cd2 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049216 Sep 13 19:55:05.368811 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 284/567] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 19:55:05 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:55:06.386991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:06.389380 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:06.396158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.396612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.397081 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.397769 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:06.398210 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:06.398640 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:06.429372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4e56f13d-572a-4dcb-b049-f6c09e8a88de tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049757 Sep 13 19:55:06.429931 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 284/568] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 19:55:06 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:55:07.442585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:07.444695 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:07.451779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.452257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.452662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.453389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:07.453837 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:07.454261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:07.484578 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9d694df5-1709-433e-829c-dbdd905503fc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046022 Sep 13 19:55:07.485219 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 285/569] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 19:55:07 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:55:08.501755 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:08.505189 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:08.514543 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.515006 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.515436 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.516132 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:08.516579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:08.517034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:08.548171 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-eaee9f71-b76f-4130-a932-aada536ff327 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053398 Sep 13 19:55:08.548723 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 285/570] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 19:55:08 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:55:09.568666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:09.571372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:09.579769 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.580367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.580934 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.581783 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.582347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.582856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.614513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5b2ed74f-6ccd-4ac9-8e48-00a93ed58a40 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050873 Sep 13 19:55:09.615287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 286/571] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 19:55:09 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:09.682731 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:09.683356 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:09.690281 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.690764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.691208 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.691899 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.692341 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.692753 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.719014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:55:09.798183 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-78836779-5b9a-406c-976c-b36f491c5a86 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 204 len: 0 microversion: 2.20 time: 0.120196 Sep 13 19:55:09.798651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 286/572] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 19:55:09 2022] DELETE /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 19:55:09.807305 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:09.808165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:09.814388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.814934 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.815432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:09.816140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:09.816713 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:09.817214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:10.075982 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:10.085435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:10.087392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:10.088709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f5e3bc8b-70c0-49ee-a0a8-72880cd68b0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.285626 Sep 13 19:55:10.089392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 287/573] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:09 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:55:11.115264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:11.115957 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:11.122769 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.123248 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.123682 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.124369 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:11.124813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:11.125264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:11.266883 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:11.275272 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:11.276733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:11.277931 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-55db176b-9dad-4065-bfb3-7597e6f4cb0e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.166967 Sep 13 19:55:11.278487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 287/574] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:11 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:12.304334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:12.305100 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:12.311873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.312394 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.312826 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.313557 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:12.314010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:12.314430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:12.468604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:12.476842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:12.478340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:12.479512 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9c4823b5-58f3-42a2-972b-2501b2dd5cbb tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1724 microversion: 2.20 time: 0.179269 Sep 13 19:55:12.480079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 288/575] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:12 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:13.134790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-232bf793-ad4f-4472-b5a4-25ade29c316f req-f409da30-5492-47dd-bfbe-cb58c3ad21da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc2f361-c297-4a69-9898-d4d3cc310118", "name": "network-vif-deleted", "tag": "8c0ed42f-e532-4877-8eca-a8af525da34e"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:13.150194 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-232bf793-ad4f-4472-b5a4-25ade29c316f req-f409da30-5492-47dd-bfbe-cb58c3ad21da service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.150663 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-232bf793-ad4f-4472-b5a4-25ade29c316f req-f409da30-5492-47dd-bfbe-cb58c3ad21da service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.151081 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-232bf793-ad4f-4472-b5a4-25ade29c316f req-f409da30-5492-47dd-bfbe-cb58c3ad21da service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.164306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-232bf793-ad4f-4472-b5a4-25ade29c316f req-f409da30-5492-47dd-bfbe-cb58c3ad21da service nova] Creating event network-vif-deleted:8c0ed42f-e532-4877-8eca-a8af525da34e for instance 9fc2f361-c297-4a69-9898-d4d3cc310118 on hv-cinder-82880 Sep 13 19:55:13.169807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-232bf793-ad4f-4472-b5a4-25ade29c316f req-f409da30-5492-47dd-bfbe-cb58c3ad21da service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038753 Sep 13 19:55:13.170558 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 288/576] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:13.503950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:13.505593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:13.512923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.513851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.514799 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.515986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.516641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.517306 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.578240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:13.579091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:13.579550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:13.580016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lazy-loading 'fault' on Instance uuid 9fc2f361-c297-4a69-9898-d4d3cc310118 {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:13.640726 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:13.649842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:13.651579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:13.652770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e1b2d1d7-2bac-482a-bca3-94161516709c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 200 len: 1372 microversion: 2.20 time: 0.152861 Sep 13 19:55:13.653371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 289/577] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:13 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:14.283862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:14.286188 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:14.293703 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.294433 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.295042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.295912 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.296490 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.297058 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.374055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-15437c1d-8676-4b49-9a57-d5dcfb0917d4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/action" status: 202 len: 0 microversion: 2.1 time: 0.094145 Sep 13 19:55:14.374650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 289/578] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:55:14 2022] POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:55:14.383371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:14.384251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:14.390874 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.391371 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.391847 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.392525 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.393166 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.393598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.546110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:14.555327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1f89d872-a467-49d9-9d66-f40425dc20fd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1750 microversion: 2.1 time: 0.176093 Sep 13 19:55:14.555909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 290/579] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:14 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1750 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:14.679475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:14.686426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:14.698419 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.699380 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.700049 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.701206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:14.702367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:14.702990 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:14.718916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] HTTP exception thrown: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Request method failure captured: Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 HTTP/1.1 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN7_Y_2pS-Od7gGSTDKXVha_IW_IdyBR7hyQwiRF6-rK94mSX2UVyZB_TMd6mJXO1iqWDXRzOHL-BTYPA97qxl4pDjv8t04TuQd3ZHpb8po-SJbOPZLjpw1rCkNw7vMPRae5yJU9-TEPuxFbm1Wa4lQcrJk2x-bgsRQ1FV1NU0E_iS4 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:55:14.720839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd32f4615dd0450f8cc175e0bfcfc4a1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}] Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: dbea9a6a35c6445a9ab76ee7278abda4 Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:55:14.722515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '9fc2f361-c297-4a69-9898-d4d3cc310118'} Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:55:14.723507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:55:14.725251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:14.726732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Returning 404 to user: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:55:14.726732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-717df6c5-56d3-4d42-b347-f643f46dbd2d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 404 len: 111 microversion: 2.20 time: 0.048573 Sep 13 19:55:14.730071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 290/580] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:14 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:55:14.735772 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-72fcd6cb-c768-43ff-8bb6-ddf204c280a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '.version_select at 0x7f98b6af8c10>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:14.763341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-72fcd6cb-c768-43ff-8bb6-ddf204c280a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473984862" status: 204 len: 0 microversion: 2.20 time: 0.031711 Sep 13 19:55:14.764288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 291/581] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Sep 13 19:55:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473984862 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 19:55:15.512036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8135d8ac-737b-421f-9aad-3199b9cb7f12 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'create', calling method: .version_select at 0x7f98b68b4670>, body: {"keypair": {"name": "tempest-keypair-1707351010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiexRRSY8AbE5HHbLyG+KXhV5AKrXDGnVFPD6qHjNjeUat0PQBYGdeXH64D8Irgdp+/+DatcIsTZD+vMUPaFCg0G8yYN+ajAM6t4PBuSoU2sOycYV60n5x/xbVFpBPBwA=="}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:15.528055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-8135d8ac-737b-421f-9aad-3199b9cb7f12 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:55:15.532214 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-8135d8ac-737b-421f-9aad-3199b9cb7f12 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for user dbea9a6a35c6445a9ab76ee7278abda4 and project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:55:15.558757 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8135d8ac-737b-421f-9aad-3199b9cb7f12 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050689 Sep 13 19:55:15.559358 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 291/582] 10.222.0.18 () {62 vars in 1200 bytes} [Tue Sep 13 19:55:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 19:55:15.580634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:15.581293 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:15.588651 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.589173 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.589626 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.590369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:15.590753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:15.591173 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:15.755416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:15.764180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6b38fd8e-87c4-4491-b5f3-83b6dfd4caa2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.188158 Sep 13 19:55:15.764778 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 292/583] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:15 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:16.788826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:16.789645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:16.799479 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.799973 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.800406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.801650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:16.802527 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:16.803296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:16.918731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2008535702", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "812691de-b220-4f78-84eb-5c9190d77034"}], "security_groups": [{"name": "tempest-securitygroup--1175308357"}], "key_name": "tempest-keypair-1707351010", "user_data": "}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:17.038704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:17.048145 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-17ba9c96-71aa-4734-a2ce-ec89a273417b tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.264274 Sep 13 19:55:17.060940 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 292/584] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:16 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:17.066050 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] validate_networks() for [('812691de-b220-4f78-84eb-5c9190d77034', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:55:17.489561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:55:17.489984 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:55:17.490457 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:55:17.490861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:55:17.491269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:55:17.500840 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.501441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.502042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.502872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:17.503320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:17.503800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:17.521636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:55:17.526570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Getting quotas for user dbea9a6a35c6445a9ab76ee7278abda4 and project cd32f4615dd0450f8cc175e0bfcfc4a1. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:55:17.538704 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:55:17.541064 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:55:17.589513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [51526b08-f84c-4d3e-8765-978a68f34042] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 19:55:18.072524 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:18.073155 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:18.075551 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:18.081072 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.081548 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.081974 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.082662 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:18.083108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:18.083523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:18.234875 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:18.243866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9ad1e581-e165-48f0-bc21-297b11478a5f tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.175274 Sep 13 19:55:18.244429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 293/585] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:18 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:18.597609 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [51526b08-f84c-4d3e-8765-978a68f34042] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 56768. Sep 13 19:55:18.602707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2f32f79f-876b-45fe-bf5a-988be54d7bf8 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.688263 Sep 13 19:55:18.603392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 293/586] 10.222.0.18 () {62 vars in 1188 bytes} [Tue Sep 13 19:55:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 19:55:18.615660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-364fb2d6-2563-49d7-b269-4a6f629f73bd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:18.616286 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-364fb2d6-2563-49d7-b269-4a6f629f73bd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:18.679490 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-364fb2d6-2563-49d7-b269-4a6f629f73bd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:18.689180 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-364fb2d6-2563-49d7-b269-4a6f629f73bd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:18.691315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-364fb2d6-2563-49d7-b269-4a6f629f73bd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:18.692441 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-364fb2d6-2563-49d7-b269-4a6f629f73bd tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1282 microversion: 2.20 time: 0.080867 Sep 13 19:55:18.693204 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 294/587] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:18 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:19.271414 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:19.272030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:19.279511 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.280001 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.280561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.281326 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.281771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.282257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.450427 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:19.459617 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3d28f4de-a8a5-4830-8e8d-11c1d768ed4d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.193520 Sep 13 19:55:19.460367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 294/588] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:19 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:19.718850 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:19.719813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:19.727220 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.727786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.728271 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.729254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:19.730346 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:19.730760 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:19.799344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:19.807927 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:19.809400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:19.810599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-fee2095e-efca-4ea2-b9c0-6b02c1b48d5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1334 microversion: 2.20 time: 0.096114 Sep 13 19:55:19.811159 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 295/589] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:19 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:20.483403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:20.495152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:20.515840 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.516445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.516976 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.517805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.518259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.518863 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.688127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:20.698881 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e06c59cd-a3f6-47ce-aaf0-1a8d464ac2a4 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.219213 Sep 13 19:55:20.700996 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 295/590] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:20 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:20.836042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:20.837301 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:20.847664 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.848051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.848487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.849251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:20.849785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:20.850101 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:20.990768 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:20.999372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:21.000810 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:21.001965 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-52738836-5d0d-477d-a433-3f52e9f4271e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.170097 Sep 13 19:55:21.002522 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 296/591] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:20 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:21.603420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-b2d2eaf7-51cf-45ac-9168-2550325149d6 req-e960d550-b137-4fcf-965a-1697c959e1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410ea540-ddf5-48c4-80c4-74588ebb619c", "tag": "dc7a4c05-de58-4ed4-9f0a-e663f9d680f9"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:21.616283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-b2d2eaf7-51cf-45ac-9168-2550325149d6 req-e960d550-b137-4fcf-965a-1697c959e1aa service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.616777 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-b2d2eaf7-51cf-45ac-9168-2550325149d6 req-e960d550-b137-4fcf-965a-1697c959e1aa service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.617887 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-b2d2eaf7-51cf-45ac-9168-2550325149d6 req-e960d550-b137-4fcf-965a-1697c959e1aa service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.632684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-b2d2eaf7-51cf-45ac-9168-2550325149d6 req-e960d550-b137-4fcf-965a-1697c959e1aa service nova] Creating event network-changed:dc7a4c05-de58-4ed4-9f0a-e663f9d680f9 for instance 410ea540-ddf5-48c4-80c4-74588ebb619c on hv-cinder-82880 Sep 13 19:55:21.641666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-b2d2eaf7-51cf-45ac-9168-2550325149d6 req-e960d550-b137-4fcf-965a-1697c959e1aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042270 Sep 13 19:55:21.642634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 296/592] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:21.693876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.696538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.703096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.703784 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.704390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.705332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.705922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.706482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.725435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.726297 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.734996 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.735466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.735898 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.739056 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.739508 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.739944 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.743835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7ffa37ec-a384-478c-bee7-0a0c54d3bbdc tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053946 Sep 13 19:55:21.746278 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 297/593] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:21 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 19:55:21.812841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.813355 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.819615 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.820307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.820740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.821540 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.821980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.822397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.848860 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:55:21.909984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:21.924415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:21.935867 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-45ae3a1e-0897-4bbf-9fef-5ed8a55bb56a tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.214416 Sep 13 19:55:21.936655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 297/594] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:21 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:21.964106 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8b280bc7-b5b4-41f7-8609-6c58da98263a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 204 len: 0 microversion: 2.1 time: 0.154859 Sep 13 19:55:21.964716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 298/595] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:55:21 2022] DELETE /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 19:55:21.973419 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:21.974002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:21.980110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.980611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.981048 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:21.981738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:21.982264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:21.982673 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.031969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:22.032970 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:22.039492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.040045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.040556 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.041904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.041904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.042392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.155774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:22.164733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f06ad046-3aca-4d8c-882a-ffe903ea8999 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1672 microversion: 2.1 time: 0.195523 Sep 13 19:55:22.165374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 298/596] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:21 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:22.201985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:22.210303 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:22.211722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:22.212828 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f6a0353a-3ba4-47cf-83be-83df6e449333 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.186418 Sep 13 19:55:22.213428 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 299/597] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:22 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:22.959048 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:22.959642 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:22.967086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.967581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.968008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:22.968704 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:22.969199 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:22.969616 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.119765 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:23.129183 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-207253a6-9561-4964-aa1e-168edaf3f59c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.174073 Sep 13 19:55:23.129900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 299/598] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:22 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:23.189292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:23.189919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:23.196489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.197021 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.197456 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.198147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.198625 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.199042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.238010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:23.238626 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:23.245650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.246113 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.246549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.247238 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:23.247666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:23.248981 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:23.392339 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:23.400392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3b13dc75-7ba1-4e72-9c9b-713a0da91c90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1672 microversion: 2.1 time: 0.215577 Sep 13 19:55:23.400972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 300/599] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:23 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:23.418935 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:23.428036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:23.429498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:23.430599 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1073517e-fdf1-4914-86fa-6a787aa62c7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.196589 Sep 13 19:55:23.431152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 300/600] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:23 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:55:24.153047 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:24.153545 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:24.160165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.160641 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.161126 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.162168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.162612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.163027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.315483 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:24.327283 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-90accb26-f5cd-4174-bcb6-f392d5368318 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.178296 Sep 13 19:55:24.327849 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 301/601] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:24 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:24.426055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:24.426763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:24.435968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.436488 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.436915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.437639 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.438086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.438505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.456922 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:24.573733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:24.581424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4d10d241-9580-441e-a359-6024e2fff6b7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1672 microversion: 2.1 time: 0.160702 Sep 13 19:55:24.581982 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 301/602] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:24 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:24.691309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:24.691918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:24.697878 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.698355 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.698789 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.699446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:24.699891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:24.700307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:24.836630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:24.846096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:24.848429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:24.850273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e4d27e14-d988-4874-9a60-5a44d52e6be5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.398701 Sep 13 19:55:24.850852 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 302/603] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:24 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:25.351467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:25.352428 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:25.359650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.360259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.360698 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.361821 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.362432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.362813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.606481 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:25.607233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:25.614489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.614971 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.615401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.616098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.616591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.616998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.729457 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:25.740317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-63b65b5f-4ff0-457c-ab54-4eef6cde2ccd tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.393063 Sep 13 19:55:25.740955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 302/604] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:25 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:25.879865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:25.880752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:25.887857 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.888973 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.889582 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.890543 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:25.891085 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:25.891418 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:25.966804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:25.975645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-67258ba4-357c-4efe-9bc2-ff2c837e6421 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1672 microversion: 2.1 time: 0.373165 Sep 13 19:55:25.976417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 303/605] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:25 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1672 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:26.129973 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:26.138968 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:26.140200 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:26.141492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f4a58e41-8ed6-47a6-a551-e8a93524265a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.268663 Sep 13 19:55:26.142061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 303/606] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:25 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:26.524329 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-c79aa8fb-2f7e-416a-a3db-5b1b378a04af req-067e776d-6e01-42fa-ab28-e19c29b8bba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd47672-e41a-48a6-a6ca-b89eb476d3a6", "name": "network-vif-deleted", "tag": "7b71a18c-2ac5-4fb9-9e78-310505103f18"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:26.541968 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-c79aa8fb-2f7e-416a-a3db-5b1b378a04af req-067e776d-6e01-42fa-ab28-e19c29b8bba0 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.542542 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-c79aa8fb-2f7e-416a-a3db-5b1b378a04af req-067e776d-6e01-42fa-ab28-e19c29b8bba0 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.542951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-c79aa8fb-2f7e-416a-a3db-5b1b378a04af req-067e776d-6e01-42fa-ab28-e19c29b8bba0 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.561247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-c79aa8fb-2f7e-416a-a3db-5b1b378a04af req-067e776d-6e01-42fa-ab28-e19c29b8bba0 service nova] Creating event network-vif-deleted:7b71a18c-2ac5-4fb9-9e78-310505103f18 for instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 on hv-cinder-82880 Sep 13 19:55:26.566686 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-c79aa8fb-2f7e-416a-a3db-5b1b378a04af req-067e776d-6e01-42fa-ab28-e19c29b8bba0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050801 Sep 13 19:55:26.572276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 304/607] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:26.764964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:26.765533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:26.772453 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.773091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.773638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.774421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:26.774879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:26.775306 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:26.951980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:26.960784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-83b30980-8c5a-4d07-9cfa-317c2da96180 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.200624 Sep 13 19:55:26.961395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 304/608] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:26 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:27.001827 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:27.003345 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:27.010331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.010965 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.011344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.012144 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.012630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.013234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.052678 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.053197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.053674 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.054233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lazy-loading 'fault' on Instance uuid abd47672-e41a-48a6-a6ca-b89eb476d3a6 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:27.100976 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:27.109500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-03ba7c62-aafe-408f-bbe8-2f977f1c0a63 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 200 len: 1326 microversion: 2.1 time: 0.112892 Sep 13 19:55:27.110052 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 305/609] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:26 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:27.170206 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:27.170814 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:27.176999 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.177491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.178067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.178820 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.179297 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.179748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.316871 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:27.330085 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:27.331513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:27.332630 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-349ce78b-c792-4099-be79-f1edfe39b057 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.166677 Sep 13 19:55:27.333260 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 305/610] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:27 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:27.969084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-0af969ac-dca6-43bd-aa48-19e661d8295c req-9f736d9f-4fd6-4bc8-a788-c1a834f9a40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ea540-ddf5-48c4-80c4-74588ebb619c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7a4c05-de58-4ed4-9f0a-e663f9d680f9"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:27.982005 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-0af969ac-dca6-43bd-aa48-19e661d8295c req-9f736d9f-4fd6-4bc8-a788-c1a834f9a40f service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:27.982469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-0af969ac-dca6-43bd-aa48-19e661d8295c req-9f736d9f-4fd6-4bc8-a788-c1a834f9a40f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:27.982892 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-0af969ac-dca6-43bd-aa48-19e661d8295c req-9f736d9f-4fd6-4bc8-a788-c1a834f9a40f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:27.995388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-0af969ac-dca6-43bd-aa48-19e661d8295c req-9f736d9f-4fd6-4bc8-a788-c1a834f9a40f service nova] Creating event network-vif-plugged:dc7a4c05-de58-4ed4-9f0a-e663f9d680f9 for instance 410ea540-ddf5-48c4-80c4-74588ebb619c on hv-cinder-82880 Sep 13 19:55:28.000485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-0af969ac-dca6-43bd-aa48-19e661d8295c req-9f736d9f-4fd6-4bc8-a788-c1a834f9a40f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035176 Sep 13 19:55:28.001159 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 306/611] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:28.055263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.055881 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:28.057977 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:28.058779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:28.065745 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.066216 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.066868 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.067579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.068098 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.068562 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.134814 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.136323 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:28.142734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.143219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.143676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.144517 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.144980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.145590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.160292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] HTTP exception thrown: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Request method failure captured: Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 HTTP/1.1 Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN8G_3fKz5VQV1zivd1stc8QLHLxJqsPYkxc1NV0URWzJER2jnW7ZHz_Cb4gz5G-AKQdnCW8CZjm7nEWXTuL7U98fJ1PtoIpLcQ4qR0hLkurD_OJmYMp8vWHwM7GWBUs7PNmLIceE169TGxesPRJy1fy8FLcLqOqDTjey7fHIf3HXqQ Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:55:28.162378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ee86defec834a3c9613ca3dfa5e4350", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}] Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: e60df169b5dc4aa59b5b0246544ef2b6 Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:55:28.163919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'abd47672-e41a-48a6-a6ca-b89eb476d3a6'} Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:55:28.164845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:55:28.166408 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:28.167857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Returning 404 to user: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:55:28.167857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8b0f1080-646d-4a90-b79c-14d2ea6c1e91 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 404 len: 111 microversion: 2.1 time: 0.033524 Sep 13 19:55:28.168083 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 307/612] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:28 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:55:28.173040 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5ffdb819-503d-46fe-b337-4ab814b1fca7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '.version_select at 0x7f98b6b42c10>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.203733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5ffdb819-503d-46fe-b337-4ab814b1fca7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374542527" status: 202 len: 0 microversion: 2.1 time: 0.034307 Sep 13 19:55:28.204330 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 308/613] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 13 19:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374542527 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:55:28.266337 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:28.277433 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8e847e37-1fb8-4948-a554-144f55b4e780 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.226189 Sep 13 19:55:28.278670 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 306/614] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:28 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:28.361581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:28.362396 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:28.373561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.374502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.375419 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.376409 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:28.377093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:28.378056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:28.575719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:28.585257 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:28.587024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:28.588399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4eeafa84-4c0b-40f1-bfd7-39d35d3424ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.233168 Sep 13 19:55:28.589392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 309/615] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:28 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:55:28.976384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-90c0bc23-de2d-42c6-9ece-bc5c176ccb5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'create', calling method: .version_select at 0x7f98b6bb9940>, body: {"keypair": {"name": "tempest-keypair-274692336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHioXnF9R/wOCCknzBJj4TbWjVWalNKWV29nL9bJG94FBbVz/AWLE571+jOn4Ym+OC5ONANFF5ub8YknH/qVDiNW0yEvV1JwHu29we/QHKPdjj4X/WknwnnzF5eWChJWgQ=="}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:28.992735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-90c0bc23-de2d-42c6-9ece-bc5c176ccb5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:55:28.997779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-90c0bc23-de2d-42c6-9ece-bc5c176ccb5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for user e60df169b5dc4aa59b5b0246544ef2b6 and project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:55:29.025915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-90c0bc23-de2d-42c6-9ece-bc5c176ccb5d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054287 Sep 13 19:55:29.026717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 307/616] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:55:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:29.303973 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.305191 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.307271 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:29.314559 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.315307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.315896 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.316611 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.317089 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.317504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.348299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.348720 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.355730 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.356308 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.357234 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.357888 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.358405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.359045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.456972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'services' on Instance uuid a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:29.510968 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:29.521092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-70bcfa46-a814-4641-84c2-7533d90d8219 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.221209 Sep 13 19:55:29.522872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 310/617] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:29 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:29.556624 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-297235b3-e9ad-412d-9be1-5f1a464149cd tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments/9c074390-f63f-4c9a-8ea5-f22927d1f939" status: 202 len: 0 microversion: 2.1 time: 0.213073 Sep 13 19:55:29.557255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 308/618] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:55:29 2022] DELETE /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments/9c074390-f63f-4c9a-8ea5-f22927d1f939 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:55:29.566818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.569244 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.575576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.576044 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.576509 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.577258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.577755 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.578150 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.610628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-53319380-42ab-4693-90b2-5053377abe84 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Sep 13 19:55:29.611557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 311/619] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:29 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:29.614485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:29.615211 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:29.622281 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.622768 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.623198 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.623963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:29.624492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:29.624904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:29.775695 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:29.787019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:29.788806 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:29.790021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3136f486-8afc-4c80-8376-c587af3aac8e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1408 microversion: 2.20 time: 0.180064 Sep 13 19:55:29.793264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 309/620] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:29 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:30.520974 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-651789666", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ab97bd9-58ce-4549-8897-4ab0eb987fb8"}], "security_groups": [{"name": "tempest-securitygroup--44237978"}], "key_name": "tempest-keypair-274692336", "user_data": "}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:30.546695 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:30.547298 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:30.553904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.554407 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.554832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.563115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.563115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.563115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.673050 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] validate_networks() for [('0ab97bd9-58ce-4549-8897-4ab0eb987fb8', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:55:30.809951 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:30.818989 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-14d8f260-9258-4935-848d-a1caa84ad66d tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1755 microversion: 2.1 time: 0.276054 Sep 13 19:55:30.819615 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 310/621] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:30 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1755 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:30.825725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:30.828372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:30.834940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.835435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.835865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.836765 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.837253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.837711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.873366 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a7f4a9a4-c25a-445d-be14-ee5b16543b8f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052648 Sep 13 19:55:30.873961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 311/622] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:30 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:30.879324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:30.880297 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:30.887255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.887811 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.888287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:30.889059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:30.889510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:30.890083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.180935 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:31.189774 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:31.191191 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:31.192373 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b8c92766-5499-4793-9f00-ec0cbc97c643 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1599 microversion: 2.20 time: 0.317233 Sep 13 19:55:31.208917 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 312/623] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:55:30 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1599 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:55:31.218307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.218812 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.225487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.226178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.226760 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.227626 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.227746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:55:31.228196 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:55:31.228324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.228748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.228857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:55:31.229326 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:55:31.229796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:55:31.241618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.242198 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.242930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.243918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.244368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.244784 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.271541 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:55:31.281070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Getting quotas for user e60df169b5dc4aa59b5b0246544ef2b6 and project 3ee86defec834a3c9613ca3dfa5e4350. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:55:31.294787 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:55:31.297684 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:55:31.323966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-71b88eda-e380-4304-91d5-011b0db49a57 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109620 Sep 13 19:55:31.324568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 313/624] 10.222.0.18 () {60 vars in 1316 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 19:55:31.351957 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-58db2df4-c092-413c-b17b-a5879607b5e7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.835542 Sep 13 19:55:31.352758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 312/625] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:55:30 2022] POST /compute/v2.1/servers => generated 400 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:55:31.442094 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b44e7ad1-0e1b-4f35-9bd9-1c386c8c36ea tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.442704 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b44e7ad1-0e1b-4f35-9bd9-1c386c8c36ea tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.516152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b44e7ad1-0e1b-4f35-9bd9-1c386c8c36ea tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:31.526611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b44e7ad1-0e1b-4f35-9bd9-1c386c8c36ea tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1236 microversion: 2.1 time: 0.163744 Sep 13 19:55:31.527589 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 314/626] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1236 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:31.846698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.847276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.854734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.855590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.856025 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.856755 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.857392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.857798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.885544 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:31.888507 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:31.898654 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.899244 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.899748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.900700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:31.901271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:31.901829 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:31.938163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4728ce00-3cd2-49cc-b936-c04b05015d21 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056749 Sep 13 19:55:31.938755 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 315/627] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 19:55:32.022666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:32.023165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:32.027171 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:32.032231 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.032972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.033570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.034451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.035041 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.035478 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.066569 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:55:32.165491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2be45f22-6064-42ff-b47c-95ca58b20de0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 204 len: 0 microversion: 2.1 time: 0.147347 Sep 13 19:55:32.166316 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 316/628] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:55:32 2022] DELETE /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:55:32.175047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:32.175796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:32.182376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.182863 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.183293 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.184038 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.184490 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.184939 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.430779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:32.440154 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-775f8d46-ba15-4311-a586-d675dba41698 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1758 microversion: 2.1 time: 0.597848 Sep 13 19:55:32.440722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 313/629] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:31 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1758 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:32.464416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:32.472687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-28142339-e52c-4e23-ad46-44b8cbc24d11 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1689 microversion: 2.1 time: 0.301740 Sep 13 19:55:32.473303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 317/630] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:32 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1689 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:32.547904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:32.548629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:32.554748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.555203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.555635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.556320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.556766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.557212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.631719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:32.640661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9efc27cd-7b46-4008-b9aa-e1cee988a1aa tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1288 microversion: 2.1 time: 0.096900 Sep 13 19:55:32.641284 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 314/631] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:32 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:32.908914 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-a46767e3-654d-48d7-9fe4-34379c02f805 req-3edbfe56-2ab9-4fd1-be9c-f5e355bc8f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410ea540-ddf5-48c4-80c4-74588ebb619c", "tag": "dc7a4c05-de58-4ed4-9f0a-e663f9d680f9"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:32.919523 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-a46767e3-654d-48d7-9fe4-34379c02f805 req-3edbfe56-2ab9-4fd1-be9c-f5e355bc8f1f service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:32.920004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-a46767e3-654d-48d7-9fe4-34379c02f805 req-3edbfe56-2ab9-4fd1-be9c-f5e355bc8f1f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:32.920433 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-a46767e3-654d-48d7-9fe4-34379c02f805 req-3edbfe56-2ab9-4fd1-be9c-f5e355bc8f1f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:32.924325 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:32.934083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-a46767e3-654d-48d7-9fe4-34379c02f805 req-3edbfe56-2ab9-4fd1-be9c-f5e355bc8f1f service nova] Creating event network-changed:dc7a4c05-de58-4ed4-9f0a-e663f9d680f9 for instance 410ea540-ddf5-48c4-80c4-74588ebb619c on hv-cinder-82880 Sep 13 19:55:32.939285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-a46767e3-654d-48d7-9fe4-34379c02f805 req-3edbfe56-2ab9-4fd1-be9c-f5e355bc8f1f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034031 Sep 13 19:55:32.939900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 318/632] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:33.496837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:33.497493 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:33.504157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.504648 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.505073 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.505796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.506270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.506690 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.638014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:33.646027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7c647675-34d7-415d-bd99-64cfcc3eaac0 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1689 microversion: 2.1 time: 0.153145 Sep 13 19:55:33.646592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 315/633] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:33 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:33.666373 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:33.667142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:33.674901 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.675426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.675862 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.676817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:33.677325 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:33.677748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:33.742748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:33.750890 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-58d1796e-d735-4a4d-98db-d47177e460b3 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1288 microversion: 2.1 time: 0.090714 Sep 13 19:55:33.751523 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 319/634] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:33 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:34.773664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:34.774317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:34.780853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:34.781372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.781372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.781656 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:34.781820 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.782444 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.782884 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.783294 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.788340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.788905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.789528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.790217 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:34.790661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:34.791076 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:34.858274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:34.871889 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9b4eb6c1-6410-425d-b888-6737db00ed27 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1288 microversion: 2.1 time: 0.101668 Sep 13 19:55:34.872954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 320/635] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:34 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1288 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:34.948721 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:34.956813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-427cd6d2-bad1-43d5-8ff6-b46266ffb8fe tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1689 microversion: 2.1 time: 0.290698 Sep 13 19:55:34.957388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 316/636] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:34 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1689 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:35.895798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:35.896579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:35.908742 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.909379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.909920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.911193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.911343 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.915796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.980030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:35.982314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:35.991763 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.992592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.993316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:35.994252 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:35.994909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:35.995537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.030229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:36.042260 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5d0c3adc-3d82-4c24-9a35-66f6e61790a0 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1296 microversion: 2.1 time: 0.150909 Sep 13 19:55:36.046150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 321/637] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:35 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1296 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:36.271429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:36.281051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e06dd4eb-65c6-41f6-968f-e1dfb5d822f5 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1689 microversion: 2.1 time: 0.305033 Sep 13 19:55:36.281835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 317/638] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:35 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1689 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:55:36.958711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-e163b266-27f8-4ee9-b0af-de194528443c req-2c4d1f05-ce8f-41b7-b3f8-d48498a89867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9b1b8b5-f84c-4ba9-9bf9-75535a05af91", "name": "network-vif-deleted", "tag": "b09f2e8a-de1a-4977-93b0-5ea0ae7926e1"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:36.969871 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-e163b266-27f8-4ee9-b0af-de194528443c req-2c4d1f05-ce8f-41b7-b3f8-d48498a89867 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:36.970998 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-e163b266-27f8-4ee9-b0af-de194528443c req-2c4d1f05-ce8f-41b7-b3f8-d48498a89867 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:36.971582 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-e163b266-27f8-4ee9-b0af-de194528443c req-2c4d1f05-ce8f-41b7-b3f8-d48498a89867 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:36.984287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-e163b266-27f8-4ee9-b0af-de194528443c req-2c4d1f05-ce8f-41b7-b3f8-d48498a89867 service nova] Creating event network-vif-deleted:b09f2e8a-de1a-4977-93b0-5ea0ae7926e1 for instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 on hv-cinder-82880 Sep 13 19:55:36.989894 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-e163b266-27f8-4ee9-b0af-de194528443c req-2c4d1f05-ce8f-41b7-b3f8-d48498a89867 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034678 Sep 13 19:55:36.990868 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 322/639] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:37.067404 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:37.068148 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:37.078556 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.079054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.081785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.082601 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.083070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.083499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.115618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:37.306528 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:37.307252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:37.319851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.320492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.321159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.322047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.322655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.323230 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.373409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.373993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.374497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.375159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'fault' on Instance uuid a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:37.387528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:37.397097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7f100d49-9bce-49d9-90c8-dadb4a862278 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.333424 Sep 13 19:55:37.398505 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 318/640] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:37 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:37.439648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:37.447618 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9e999d51-1412-4b85-8616-bff2116e509e tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 200 len: 1335 microversion: 2.1 time: 0.146933 Sep 13 19:55:37.451483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 323/641] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:37 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 1335 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:37.860432 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-aeca87e3-ed8d-4052-89ce-f7ae072c83a4 req-221b2808-992a-4e0f-bedb-343738e286a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc", "tag": "886e27a1-23fa-4ba2-b59c-67d88c830176"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:37.871863 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-aeca87e3-ed8d-4052-89ce-f7ae072c83a4 req-221b2808-992a-4e0f-bedb-343738e286a2 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:37.872607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-aeca87e3-ed8d-4052-89ce-f7ae072c83a4 req-221b2808-992a-4e0f-bedb-343738e286a2 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:37.873230 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-aeca87e3-ed8d-4052-89ce-f7ae072c83a4 req-221b2808-992a-4e0f-bedb-343738e286a2 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:37.886048 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-aeca87e3-ed8d-4052-89ce-f7ae072c83a4 req-221b2808-992a-4e0f-bedb-343738e286a2 service nova] Creating event network-changed:886e27a1-23fa-4ba2-b59c-67d88c830176 for instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc on hv-cinder-82880 Sep 13 19:55:37.892742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-aeca87e3-ed8d-4052-89ce-f7ae072c83a4 req-221b2808-992a-4e0f-bedb-343738e286a2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035772 Sep 13 19:55:37.894557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 319/642] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:38.423103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:38.423661 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:38.430396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.430899 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.431319 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.432009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.432450 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.432868 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.476255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:38.476960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: a9b1b8b5-f84c-4ba9-9bf9-75535a05af91] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:38.485073 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.485566 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.486033 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.486733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:38.487184 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:38.487637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:38.501628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] HTTP exception thrown: Instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 could not be found. Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Request method failure captured: Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 HTTP/1.1 Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN8IWZVJgTK_kjohabZObSZmELvZaDYYGCq3h-A34bxLqZoZkgP85o1Gt98TSagy5HnN8qGNGzQn_eURe1G2bJBqGGcHCeIqeO8bSFjNXLsHvrDf5ud3D2UAtAUx88bIL6KX0KOrwThqmAurXBcKPff8h0V10QBkuMp21KERvcQ5k-4 Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:55:38.503291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_592bbccef3ef42ccbc7e2c3dc5bb86de", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}] Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: a1c9d4af0a98406692e1d79293844c68 Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 could not be found. Sep 13 19:55:38.504934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'a9b1b8b5-f84c-4ba9-9bf9-75535a05af91'} Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 could not be found. Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:55:38.505781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 could not be found. Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 could not be found. Sep 13 19:55:38.507181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:55:38.508362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Returning 404 to user: Instance a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:55:38.508362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9e09f18b-dfab-4c0e-b34d-373c47d84d2f tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91" status: 404 len: 111 microversion: 2.1 time: 0.035651 Sep 13 19:55:38.508362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 320/643] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:38 2022] GET /compute/v2.1/servers/a9b1b8b5-f84c-4ba9-9bf9-75535a05af91 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:55:38.513711 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2fe89b35-e103-4829-85b4-7b2a4a6c6f2d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '.version_select at 0x7f98b6896e50>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:38.533401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2fe89b35-e103-4829-85b4-7b2a4a6c6f2d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387464593" status: 202 len: 0 microversion: 2.1 time: 0.023497 Sep 13 19:55:38.534179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 321/644] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 19:55:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387464593 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 19:55:38.570404 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:38.578317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9b80b25d-df46-4df4-aa8a-b6898c6bddc2 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.159302 Sep 13 19:55:38.578894 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 324/645] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:38 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:39.606537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:39.607232 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:39.614474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.615128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.615647 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.616415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:39.616962 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:39.617452 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:39.871960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:39.880640 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a2f0b1b1-4648-46c0-b4a2-865c84084f90 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.278889 Sep 13 19:55:39.881614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 322/646] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:39 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:40.908225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:40.908844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:40.916397 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.916899 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.917337 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:40.918026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:40.918471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:40.918892 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.057604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:41.066792 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-398880dc-0162-4751-8a58-0430ce2cc2b8 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.163823 Sep 13 19:55:41.067423 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 325/647] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:40 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:41.895569 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:41.896097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:41.898660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:41.899317 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:41.905078 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.905561 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.906010 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.906710 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:41.907157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:41.907574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:41.937472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:55:42.043315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-500031c9-a6d8-49c1-bf79-af73c4b4b205 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 204 len: 0 microversion: 2.1 time: 0.150885 Sep 13 19:55:42.044380 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 323/648] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:55:41 2022] DELETE /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:55:42.053571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:42.054168 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:42.057410 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:42.065723 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.066276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.066748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.067495 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.068112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.068530 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.088161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-89589509-6180-4c3f-9660-18f7dc8e9bc4 req-ee430c69-d86d-41d8-95bb-d7ce3fc03257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc", "name": "network-vif-plugged", "status": "completed", "tag": "886e27a1-23fa-4ba2-b59c-67d88c830176"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:42.098655 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-89589509-6180-4c3f-9660-18f7dc8e9bc4 req-ee430c69-d86d-41d8-95bb-d7ce3fc03257 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.099023 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-89589509-6180-4c3f-9660-18f7dc8e9bc4 req-ee430c69-d86d-41d8-95bb-d7ce3fc03257 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.099443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-89589509-6180-4c3f-9660-18f7dc8e9bc4 req-ee430c69-d86d-41d8-95bb-d7ce3fc03257 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.112866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-89589509-6180-4c3f-9660-18f7dc8e9bc4 req-ee430c69-d86d-41d8-95bb-d7ce3fc03257 service nova] Creating event network-vif-plugged:886e27a1-23fa-4ba2-b59c-67d88c830176 for instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc on hv-cinder-82880 Sep 13 19:55:42.117943 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-89589509-6180-4c3f-9660-18f7dc8e9bc4 req-ee430c69-d86d-41d8-95bb-d7ce3fc03257 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034593 Sep 13 19:55:42.118549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 324/649] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:55:42.123801 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:42.124405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:42.126694 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:42.133581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.134276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.134674 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.135609 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:42.136051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:42.136627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:42.245813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:42.254202 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e5cb5448-24b3-4c18-b345-29b4bcdadb37 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1509 microversion: 2.1 time: 0.205402 Sep 13 19:55:42.254897 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 326/650] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:42 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:42.290291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:42.298075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-aa4743e8-259d-4b73-bad3-d0d13d340e60 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.178207 Sep 13 19:55:42.298645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 325/651] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:42 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:43.286017 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:43.286585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:43.293439 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.294002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.294376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.295072 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.295516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.295938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.323736 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:43.324348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:43.331510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.332090 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.332596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.333455 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:43.333908 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:43.334355 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:43.484806 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:43.493117 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7f06e219-54d1-4e17-8c61-8b2147d6460d tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1509 microversion: 2.1 time: 0.218395 Sep 13 19:55:43.493810 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 327/652] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:43 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1509 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:43.512979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:43.521371 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f88396ef-d4c3-4cf0-a4f3-f90db48637d7 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.201458 Sep 13 19:55:43.521955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 326/653] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:43 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:44.515997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:44.516634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:44.523554 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.524051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.524486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.525215 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.525665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.526085 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.543984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:44.544592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:44.551485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.552055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.552579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.553375 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:44.554026 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:44.554331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:44.767016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:44.774555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:44.778823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9f76ba6c-2193-4a41-814b-c1d2e19b0e96 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1509 microversion: 2.1 time: 0.266726 Sep 13 19:55:44.779609 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 328/654] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:44 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:44.784125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-34576751-6b7f-497f-9281-0259dc874a10 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.243310 Sep 13 19:55:44.797088 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 327/655] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:44 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:45.133859 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-0035e857-8f93-4af8-b145-9c7c0a32ea12 req-1f61df03-eb8b-4321-8631-cb92322bb74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f7001c0-8809-4b82-b3f6-354d11c02d14", "name": "network-vif-deleted", "tag": "7bf5ff37-42b2-43c4-9059-f47c6c9c6cbe"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:45.143585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-0035e857-8f93-4af8-b145-9c7c0a32ea12 req-1f61df03-eb8b-4321-8631-cb92322bb74b service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.144137 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-0035e857-8f93-4af8-b145-9c7c0a32ea12 req-1f61df03-eb8b-4321-8631-cb92322bb74b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.144565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-0035e857-8f93-4af8-b145-9c7c0a32ea12 req-1f61df03-eb8b-4321-8631-cb92322bb74b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.155451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-0035e857-8f93-4af8-b145-9c7c0a32ea12 req-1f61df03-eb8b-4321-8631-cb92322bb74b service nova] Creating event network-vif-deleted:7bf5ff37-42b2-43c4-9059-f47c6c9c6cbe for instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 on hv-cinder-82880 Sep 13 19:55:45.160408 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-0035e857-8f93-4af8-b145-9c7c0a32ea12 req-1f61df03-eb8b-4321-8631-cb92322bb74b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087697 Sep 13 19:55:45.161036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 329/656] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:45.802060 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:45.802895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:45.809161 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:45.809869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:45.809978 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.810352 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.810781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.811472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.811914 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.812326 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.816964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.817243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.817726 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.819050 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.819753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.820397 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.851664 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:45.852291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:45.852720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:45.853210 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'fault' on Instance uuid 1f7001c0-8809-4b82-b3f6-354d11c02d14 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:45.918423 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:45.926544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4d9a79e5-3a8f-49c8-a4d0-71ff58be382a tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1312 microversion: 2.1 time: 0.128525 Sep 13 19:55:45.927222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 328/657] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:45 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:45.981453 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:45.989643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1e4652bd-6277-4c9c-afc4-4617a4bcb760 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1360 microversion: 2.1 time: 0.186686 Sep 13 19:55:45.990224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 330/658] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:45 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1360 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:46.949812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:46.950394 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:46.956922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.957434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.957870 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.958562 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.959010 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.959424 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.990955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:46.991785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:46.992167 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:46.992589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'fault' on Instance uuid 1f7001c0-8809-4b82-b3f6-354d11c02d14 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:47.014316 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:47.014955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:47.022217 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.022714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.023547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.024259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.024709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.025158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.036080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:47.044651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c1c5096a-56bf-43ad-9c06-84c652a4242c tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 200 len: 1312 microversion: 2.1 time: 0.098868 Sep 13 19:55:47.045262 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 329/659] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:46 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:47.164539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:47.176735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-546bb39b-be10-4292-8272-609a7ecd8201 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1546 microversion: 2.1 time: 0.167804 Sep 13 19:55:47.177159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 331/660] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:47 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:47.199041 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:47.199522 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:47.206129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.206623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.207090 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.207951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:47.208425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:47.208849 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:47.303876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bee2a61b-d778-4b13-bd3d-40f85af47100 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108653 Sep 13 19:55:47.304483 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 330/661] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 19:55:47 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:48.067666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:48.068259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: 1f7001c0-8809-4b82-b3f6-354d11c02d14] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:48.075229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.075718 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.076152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.076848 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.077396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.077844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.091972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] HTTP exception thrown: Instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 could not be found. Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Request method failure captured: Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 HTTP/1.1 Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN8IWZVJgTK_kjohabZObSZmELvZaDYYGCq3h-A34bxLqZoZkgP85o1Gt98TSagy5HnN8qGNGzQn_eURe1G2bJBqGGcHCeIqeO8bSFjNXLsHvrDf5ud3D2UAtAUx88bIL6KX0KOrwThqmAurXBcKPff8h0V10QBkuMp21KERvcQ5k-4 Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:55:48.093733 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_592bbccef3ef42ccbc7e2c3dc5bb86de", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}] Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: a1c9d4af0a98406692e1d79293844c68 Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 could not be found. Sep 13 19:55:48.095159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '1f7001c0-8809-4b82-b3f6-354d11c02d14'} Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 could not be found. Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:55:48.095872 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 could not be found. Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 could not be found. Sep 13 19:55:48.097255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:48.098438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Returning 404 to user: Instance 1f7001c0-8809-4b82-b3f6-354d11c02d14 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:55:48.098438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ebe3761b-316c-4f99-a16e-e3957aa664f7 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14" status: 404 len: 111 microversion: 2.1 time: 0.031441 Sep 13 19:55:48.098438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 332/662] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:48 2022] GET /compute/v2.1/servers/1f7001c0-8809-4b82-b3f6-354d11c02d14 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:55:48.104427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:48.104955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:48.111125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.111601 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.112029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.112719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.113199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.113615 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.138898 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:55:48.230598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6f6281c0-bd63-4dd3-949b-f8b501d0bcd6 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 204 len: 0 microversion: 2.1 time: 0.130104 Sep 13 19:55:48.232149 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 331/663] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:55:48 2022] DELETE /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:55:48.240659 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:48.245221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:48.256375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.256855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.257302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.258080 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.258646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.258932 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.290843 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-1239a7cf-3983-4f39-bcac-041ca8209441 req-26f83dac-4015-45d6-90bd-0f9f986fe371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc", "tag": "886e27a1-23fa-4ba2-b59c-67d88c830176"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:48.303829 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-1239a7cf-3983-4f39-bcac-041ca8209441 req-26f83dac-4015-45d6-90bd-0f9f986fe371 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:48.304715 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-1239a7cf-3983-4f39-bcac-041ca8209441 req-26f83dac-4015-45d6-90bd-0f9f986fe371 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:48.305305 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-1239a7cf-3983-4f39-bcac-041ca8209441 req-26f83dac-4015-45d6-90bd-0f9f986fe371 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:48.321581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-1239a7cf-3983-4f39-bcac-041ca8209441 req-26f83dac-4015-45d6-90bd-0f9f986fe371 service nova] Creating event network-changed:886e27a1-23fa-4ba2-b59c-67d88c830176 for instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc on hv-cinder-82880 Sep 13 19:55:48.327161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-1239a7cf-3983-4f39-bcac-041ca8209441 req-26f83dac-4015-45d6-90bd-0f9f986fe371 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041695 Sep 13 19:55:48.328445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 332/664] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:48.406578 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:48.414943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5ff2cdce-49d4-4d33-8388-bd24da296057 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.178559 Sep 13 19:55:48.415522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 333/665] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:48 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:49.438937 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:49.439614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:49.446729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:49.447211 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:49.447636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:49.448331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:49.448774 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:49.449223 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:49.580199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:49.588339 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-888f63d3-eab2-4f1f-8730-c3db3c706c90 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.153751 Sep 13 19:55:49.588960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 333/666] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:49 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:50.614369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:50.615030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:50.623170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.623878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.624463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.625581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:50.626152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:50.626752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:50.769750 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:50.777623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7d2ab072-9cc5-4536-9931-93ced1db08f1 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.168984 Sep 13 19:55:50.778198 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 334/667] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:50 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:51.802687 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:51.803897 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:51.811616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.812319 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.812867 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:51.813728 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:51.814629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:51.814819 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.064903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:52.068774 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:52.078709 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-cd152752-cb20-42d6-9f62-d563faa0da80 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1522 microversion: 2.1 time: 0.280339 Sep 13 19:55:52.080203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 334/668] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:51 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:52.356302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-d35fa91c-fb8c-4b7d-a5fe-3eff95b0954e req-454a3c2f-5ed4-4e5a-9b16-70a467e3d30a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4427ca0-6d69-4863-9b14-6b456b1bde67", "name": "network-vif-deleted", "tag": "d70eb4a9-b50b-433e-bbff-a0640870c674"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:55:52.366960 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d35fa91c-fb8c-4b7d-a5fe-3eff95b0954e req-454a3c2f-5ed4-4e5a-9b16-70a467e3d30a service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:52.367441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d35fa91c-fb8c-4b7d-a5fe-3eff95b0954e req-454a3c2f-5ed4-4e5a-9b16-70a467e3d30a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:52.367869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d35fa91c-fb8c-4b7d-a5fe-3eff95b0954e req-454a3c2f-5ed4-4e5a-9b16-70a467e3d30a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:52.379440 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-d35fa91c-fb8c-4b7d-a5fe-3eff95b0954e req-454a3c2f-5ed4-4e5a-9b16-70a467e3d30a service nova] Creating event network-vif-deleted:d70eb4a9-b50b-433e-bbff-a0640870c674 for instance f4427ca0-6d69-4863-9b14-6b456b1bde67 on hv-cinder-82880 Sep 13 19:55:52.384720 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-d35fa91c-fb8c-4b7d-a5fe-3eff95b0954e req-454a3c2f-5ed4-4e5a-9b16-70a467e3d30a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032046 Sep 13 19:55:52.387125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 335/669] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:55:53.103181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:53.103798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:53.111463 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.111909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.112348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.113158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.113621 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.114021 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.147994 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:53.148529 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:53.149005 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:53.149427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lazy-loading 'fault' on Instance uuid f4427ca0-6d69-4863-9b14-6b456b1bde67 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:55:53.192001 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c9d4af0a98406692e1d79293844c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '592bbccef3ef42ccbc7e2c3dc5bb86de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:55:53.199074 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3b539ce9-cc47-4ba8-9f4e-63141e00a969 tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 200 len: 1312 microversion: 2.1 time: 0.100123 Sep 13 19:55:53.199729 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 335/670] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:53 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:55:54.227112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:55:54.227862 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] [instance: f4427ca0-6d69-4863-9b14-6b456b1bde67] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:55:54.234800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.235282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.235709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.236398 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:55:54.236842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:55:54.237291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:55:54.250722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] HTTP exception thrown: Instance f4427ca0-6d69-4863-9b14-6b456b1bde67 could not be found. Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Request method failure captured: Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 HTTP/1.1 Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN8IWZVJgTK_kjohabZObSZmELvZaDYYGCq3h-A34bxLqZoZkgP85o1Gt98TSagy5HnN8qGNGzQn_eURe1G2bJBqGGcHCeIqeO8bSFjNXLsHvrDf5ud3D2UAtAUx88bIL6KX0KOrwThqmAurXBcKPff8h0V10QBkuMp21KERvcQ5k-4 Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:55:54.252338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_592bbccef3ef42ccbc7e2c3dc5bb86de", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/592bbccef3ef42ccbc7e2c3dc5bb86de"}]}] Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 592bbccef3ef42ccbc7e2c3dc5bb86de Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815101387 Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: a1c9d4af0a98406692e1d79293844c68 Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815101387-project Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance f4427ca0-6d69-4863-9b14-6b456b1bde67 could not be found. Sep 13 19:55:54.253941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'f4427ca0-6d69-4863-9b14-6b456b1bde67'} Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4427ca0-6d69-4863-9b14-6b456b1bde67 could not be found. Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:55:54.258355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4427ca0-6d69-4863-9b14-6b456b1bde67 could not be found. Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4427ca0-6d69-4863-9b14-6b456b1bde67 could not be found. Sep 13 19:55:54.260403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:55:54.261649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] Returning 404 to user: Instance f4427ca0-6d69-4863-9b14-6b456b1bde67 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:55:54.261649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7389ec2f-ef37-4ed4-a109-5c8227a1e78b tempest-ServerRescueNegativeTestJSON-815101387 tempest-ServerRescueNegativeTestJSON-815101387-project] 10.222.0.18 "GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67" status: 404 len: 111 microversion: 2.1 time: 0.033909 Sep 13 19:55:54.261649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 336/671] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:55:54 2022] GET /compute/v2.1/servers/f4427ca0-6d69-4863-9b14-6b456b1bde67 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:56:08.187042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-533328591"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:08.187748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:08.190084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:08.190714 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=9 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:08.197623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.198397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.198978 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.199840 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.200570 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.201223 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.338150 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.network.security_group_api [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Removing security group 9b4b0147-a14c-478d-add9-0f8ecc3d735f from port 0a8426a0-9e45-4b77-aa52-3f03d1426e6c Sep 13 19:56:08.667468 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d72890c8-4874-4601-8462-052bd000561c tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/action" status: 202 len: 0 microversion: 2.1 time: 0.484585 Sep 13 19:56:08.668197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 336/672] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 19:56:08 2022] POST /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:56:08.677270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:08.678527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=90 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:08.864685 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-3a99e194-b644-4394-b0ca-5d60c423d0f3 req-1706e814-dce5-40db-8e06-4d99e5f79b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2129723c-9cf0-42d5-81be-81547f40b36b", "tag": "0a8426a0-9e45-4b77-aa52-3f03d1426e6c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:08.886165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3a99e194-b644-4394-b0ca-5d60c423d0f3 req-1706e814-dce5-40db-8e06-4d99e5f79b26 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:08.886653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3a99e194-b644-4394-b0ca-5d60c423d0f3 req-1706e814-dce5-40db-8e06-4d99e5f79b26 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:08.887079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3a99e194-b644-4394-b0ca-5d60c423d0f3 req-1706e814-dce5-40db-8e06-4d99e5f79b26 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:08.906594 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-3a99e194-b644-4394-b0ca-5d60c423d0f3 req-1706e814-dce5-40db-8e06-4d99e5f79b26 service nova] Creating event network-changed:0a8426a0-9e45-4b77-aa52-3f03d1426e6c for instance 2129723c-9cf0-42d5-81be-81547f40b36b on hv-cinder-82880 Sep 13 19:56:08.912555 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-3a99e194-b644-4394-b0ca-5d60c423d0f3 req-1706e814-dce5-40db-8e06-4d99e5f79b26 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240647 Sep 13 19:56:08.913390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 337/673] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:09.146276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:09.147142 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:09.153862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.154338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.155535 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.156393 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:09.157064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:09.157698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:09.189142 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d1cdb3fb-428e-47d0-9319-5f5583ca963c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/ips" status: 200 len: 150 microversion: 2.20 time: 0.047835 Sep 13 19:56:09.190995 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 337/674] 10.222.0.18 () {60 vars in 1289 bytes} [Tue Sep 13 19:56:09 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:56:10.590440 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:10.591053 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:10.604607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.605385 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.605821 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.606601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.607045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.607537 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.715084 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lazy-loading 'services' on Instance uuid 2129723c-9cf0-42d5-81be-81547f40b36b {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:56:10.799461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-eeb54e63-3e51-4c14-a751-f867209edd97 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments/20410e85-5b5d-4584-a9d8-0dc39f69aef1" status: 202 len: 0 microversion: 2.1 time: 0.213875 Sep 13 19:56:10.800258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 338/675] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:56:10 2022] DELETE /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments/20410e85-5b5d-4584-a9d8-0dc39f69aef1 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:56:10.809539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:10.812031 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:10.821657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.822829 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.823934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.825627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.826325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.826991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.867078 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1c931ee7-9f33-4160-9edf-0755ee608ec2 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061764 Sep 13 19:56:10.867999 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 338/676] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:10 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:10.930695 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-d1ffcecc-da8c-45f0-b148-9c3c2944119f req-fc775986-ff1b-47ab-bda2-e8737d48af31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2129723c-9cf0-42d5-81be-81547f40b36b", "tag": "0a8426a0-9e45-4b77-aa52-3f03d1426e6c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:10.941600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d1ffcecc-da8c-45f0-b148-9c3c2944119f req-fc775986-ff1b-47ab-bda2-e8737d48af31 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:10.942433 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d1ffcecc-da8c-45f0-b148-9c3c2944119f req-fc775986-ff1b-47ab-bda2-e8737d48af31 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:10.943223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-d1ffcecc-da8c-45f0-b148-9c3c2944119f req-fc775986-ff1b-47ab-bda2-e8737d48af31 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:10.962950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-d1ffcecc-da8c-45f0-b148-9c3c2944119f req-fc775986-ff1b-47ab-bda2-e8737d48af31 service nova] Creating event network-changed:0a8426a0-9e45-4b77-aa52-3f03d1426e6c for instance 2129723c-9cf0-42d5-81be-81547f40b36b on hv-cinder-82880 Sep 13 19:56:10.967916 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-d1ffcecc-da8c-45f0-b148-9c3c2944119f req-fc775986-ff1b-47ab-bda2-e8737d48af31 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041277 Sep 13 19:56:10.968510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 339/677] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:11.816463 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:11.817110 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:11.825052 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.825167 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.830806 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.832767 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.833718 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.834478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.875975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lazy-loading 'flavor' on Instance uuid 410ea540-ddf5-48c4-80c4-74588ebb619c {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:56:11.881227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:11.883940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:11.915518 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.916008 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.916503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.922741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:11.924504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:11.924978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:11.995627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8e1a3258-b447-4c9a-97f3-248ef78a17f0 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119512 Sep 13 19:56:11.999569 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 340/678] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:11 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:56:12.011964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:12.012614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:12.019243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.019908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.020339 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.025462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.025462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.025462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.106612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] HTTP exception thrown: Instance 2129723c-9cf0-42d5-81be-81547f40b36b is not attached to volume 20410e85-5b5d-4584-a9d8-0dc39f69aef1 Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Request method failure captured: Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments/20410e85-5b5d-4584-a9d8-0dc39f69aef1 HTTP/1.1 Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN-2AXsiV3wPGReI8ktVmIFEAC5F5ufJ_n6iWHWPb5NO7EN04G4w36OPBw7JWkZ2qRCYuCYs5qvchswV3_DXBgCPeaHjMFyXUv385orRB5I2gOCbu47L44EqtJuMditqkxlPnEfqVz66mIctjScVT5I3HtGrXtyLbtAVfZ9zIGVrP5g Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 845d6ae8d6434c4c96e24cf39f309d23 Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-TestMinimumBasicScenario-206991169 Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:56:12.109237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/845d6ae8d6434c4c96e24cf39f309d23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_845d6ae8d6434c4c96e24cf39f309d23", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/845d6ae8d6434c4c96e24cf39f309d23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/845d6ae8d6434c4c96e24cf39f309d23"}]}] Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-TestMinimumBasicScenario-206991169 Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 845d6ae8d6434c4c96e24cf39f309d23 Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-206991169 Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-TestMinimumBasicScenario-206991169-project Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 771ba65bd2974845ac79d04ad3634c96 Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-TestMinimumBasicScenario-206991169-project Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:56:12.110658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 2129723c-9cf0-42d5-81be-81547f40b36b is not attached to volume 20410e85-5b5d-4584-a9d8-0dc39f69aef1 Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'server_id': '2129723c-9cf0-42d5-81be-81547f40b36b', 'id': '20410e85-5b5d-4584-a9d8-0dc39f69aef1'} Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 20410e85-5b5d-4584-a9d8-0dc39f69aef1. Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:56:12.111482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2129723c-9cf0-42d5-81be-81547f40b36b is not attached to volume 20410e85-5b5d-4584-a9d8-0dc39f69aef1 Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2129723c-9cf0-42d5-81be-81547f40b36b is not attached to volume 20410e85-5b5d-4584-a9d8-0dc39f69aef1 Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:12.112650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Returning 404 to user: Instance 2129723c-9cf0-42d5-81be-81547f40b36b is not attached to volume 20410e85-5b5d-4584-a9d8-0dc39f69aef1 {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:56:12.113623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ddfaf47f-8250-46bd-b326-9e3734c953da tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments/20410e85-5b5d-4584-a9d8-0dc39f69aef1" status: 404 len: 154 microversion: 2.1 time: 0.104409 Sep 13 19:56:12.117349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 341/679] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:56:12 2022] DELETE /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b/os-volume_attachments/20410e85-5b5d-4584-a9d8-0dc39f69aef1 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:56:12.162842 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-20264f22-3173-4b7d-9c54-b8015470df96 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/action" status: 202 len: 0 microversion: 2.20 time: 0.351010 Sep 13 19:56:12.163567 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 339/680] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 19:56:11 2022] POST /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:56:12.172105 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:12.173014 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:12.179503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.180007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.180386 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.181299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:12.181983 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:12.182563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:12.337901 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:12.347288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:12.348751 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:12.350434 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-419d2fa5-e9c4-48a9-8afb-3cf75549151b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.182328 Sep 13 19:56:12.351007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 342/681] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:12 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:13.287935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:13.289105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:13.296233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.296712 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.297162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.297979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.298276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.298686 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.324080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:56:13.379447 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:13.380194 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:13.387227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.388187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.388629 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.389369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.389993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.390583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.406489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d6e4ac41-fdc6-40f6-a78f-a30c60a90161 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "DELETE /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 204 len: 0 microversion: 2.1 time: 0.123074 Sep 13 19:56:13.407320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 340/682] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:56:13 2022] DELETE /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:56:13.417344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:13.418066 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:13.426060 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.426932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.427579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.428668 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:13.429873 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:13.431282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:13.595731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:13.605560 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:13.607571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:13.608700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-352fda5b-934f-48cb-bbeb-e30ceec6c625 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.236820 Sep 13 19:56:13.609578 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 343/683] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:13 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:13.629590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:13.640374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3cb14fdc-10c6-4bc8-9883-62e81d7fa654 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1554 microversion: 2.1 time: 0.227531 Sep 13 19:56:13.641309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 341/684] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:13 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:56:14.633824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:14.635129 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:14.642694 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.643191 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.643651 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.644347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.644800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.645257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.666255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:14.667465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:14.675985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.676469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.676915 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.678064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:14.678667 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:14.679290 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:14.839312 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:14.848753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:14.850633 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:14.851817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-55aec0cb-4921-48a5-a95d-e0ccd0de46a3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.222095 Sep 13 19:56:14.852700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 344/685] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:14 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:14.868010 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:14.876466 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-44195251-9a6d-4755-852e-8b404e2e1312 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1554 microversion: 2.1 time: 0.215464 Sep 13 19:56:14.877211 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 342/686] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:14 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:15.877130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:15.877781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:15.883923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.884397 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.884822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.885564 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.886010 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.886396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.902401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:15.903957 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:15.913954 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.915082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.915740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:15.916800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:15.917494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:15.918118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.128172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:16.136454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:16.138345 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:16.139596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-97017554-49d6-438a-93f9-8e103e575158 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.266478 Sep 13 19:56:16.140666 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 345/687] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:15 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:16.338526 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-00ff8f77-2c4d-4ceb-863b-f886a9d6fdf4 req-ed2979dc-57ee-46d5-b99d-01cafc5fc1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2129723c-9cf0-42d5-81be-81547f40b36b", "name": "network-vif-deleted", "tag": "0a8426a0-9e45-4b77-aa52-3f03d1426e6c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:16.340277 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771ba65bd2974845ac79d04ad3634c96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '845d6ae8d6434c4c96e24cf39f309d23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:16.348256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0e5f632b-e832-4c18-b4ba-98f822e6b55e tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 200 len: 1554 microversion: 2.1 time: 0.452381 Sep 13 19:56:16.355565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-00ff8f77-2c4d-4ceb-863b-f886a9d6fdf4 req-ed2979dc-57ee-46d5-b99d-01cafc5fc1aa service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:16.356479 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-00ff8f77-2c4d-4ceb-863b-f886a9d6fdf4 req-ed2979dc-57ee-46d5-b99d-01cafc5fc1aa service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:16.357150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-00ff8f77-2c4d-4ceb-863b-f886a9d6fdf4 req-ed2979dc-57ee-46d5-b99d-01cafc5fc1aa service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:16.364029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 343/688] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:15 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 1554 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:56:16.369420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-00ff8f77-2c4d-4ceb-863b-f886a9d6fdf4 req-ed2979dc-57ee-46d5-b99d-01cafc5fc1aa service nova] Creating event network-vif-deleted:0a8426a0-9e45-4b77-aa52-3f03d1426e6c for instance 2129723c-9cf0-42d5-81be-81547f40b36b on hv-cinder-82880 Sep 13 19:56:16.375061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-00ff8f77-2c4d-4ceb-863b-f886a9d6fdf4 req-ed2979dc-57ee-46d5-b99d-01cafc5fc1aa service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040113 Sep 13 19:56:16.376420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 346/689] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:17.166237 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:17.166871 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:17.174077 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.174586 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.174980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.175946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.176580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.177201 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.311573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:17.321529 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:17.323884 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:17.325917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1f1bb894-7bc7-4008-9910-7ebaa2f60f0c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.163848 Sep 13 19:56:17.326813 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 344/690] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:17 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:17.377165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:17.377943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] [instance: 2129723c-9cf0-42d5-81be-81547f40b36b] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:17.384771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.385287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.385722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.386473 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:17.386980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:17.387405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:17.401529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] HTTP exception thrown: Instance 2129723c-9cf0-42d5-81be-81547f40b36b could not be found. Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Request method failure captured: Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b HTTP/1.1 Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN-2AXsiV3wPGReI8ktVmIFEAC5F5ufJ_n6iWHWPb5NO7EN04G4w36OPBw7JWkZ2qRCYuCYs5qvchswV3_DXBgCPeaHjMFyXUv385orRB5I2gOCbu47L44EqtJuMditqkxlPnEfqVz66mIctjScVT5I3HtGrXtyLbtAVfZ9zIGVrP5g Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 845d6ae8d6434c4c96e24cf39f309d23 Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-TestMinimumBasicScenario-206991169 Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:56:17.403059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/845d6ae8d6434c4c96e24cf39f309d23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_845d6ae8d6434c4c96e24cf39f309d23", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/845d6ae8d6434c4c96e24cf39f309d23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/845d6ae8d6434c4c96e24cf39f309d23"}]}] Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-TestMinimumBasicScenario-206991169 Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 845d6ae8d6434c4c96e24cf39f309d23 Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-206991169 Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-TestMinimumBasicScenario-206991169-project Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 771ba65bd2974845ac79d04ad3634c96 Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-TestMinimumBasicScenario-206991169-project Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 2129723c-9cf0-42d5-81be-81547f40b36b could not be found. Sep 13 19:56:17.404610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '2129723c-9cf0-42d5-81be-81547f40b36b'} Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2129723c-9cf0-42d5-81be-81547f40b36b could not be found. Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:56:17.405527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2129723c-9cf0-42d5-81be-81547f40b36b could not be found. Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2129723c-9cf0-42d5-81be-81547f40b36b could not be found. Sep 13 19:56:17.406994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:56:17.408292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Returning 404 to user: Instance 2129723c-9cf0-42d5-81be-81547f40b36b could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:56:17.408292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-cf8fbfd3-00de-4ee6-baa6-5e0076184348 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b" status: 404 len: 111 microversion: 2.1 time: 0.035159 Sep 13 19:56:17.408292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 347/691] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:56:17 2022] GET /compute/v2.1/servers/2129723c-9cf0-42d5-81be-81547f40b36b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:56:17.414057 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e8b4565c-a606-42e7-9c7a-3fcf35397032 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] Calling method '.version_select at 0x7f98b686aca0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:17.436038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e8b4565c-a606-42e7-9c7a-3fcf35397032 tempest-TestMinimumBasicScenario-206991169 tempest-TestMinimumBasicScenario-206991169-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1633994995" status: 202 len: 0 microversion: 2.1 time: 0.026184 Sep 13 19:56:17.436589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 345/692] 10.222.0.18 () {58 vars in 1272 bytes} [Tue Sep 13 19:56:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1633994995 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:56:18.353133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:18.353886 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:18.360142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.360721 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.361252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.362204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:18.362913 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:18.363491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:18.623583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:18.636735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:18.638865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:18.640377 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-862cc2db-4c33-4fd4-b7cb-dc9181b807bc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.292766 Sep 13 19:56:18.641505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 348/693] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:18 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:19.667512 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:19.668283 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:19.674758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.675272 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.675748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.676455 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:19.677079 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:19.677351 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:19.902315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:19.910582 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:19.912004 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:19.913512 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-fa118db2-936e-4eef-b1e2-2308362301f1 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.249950 Sep 13 19:56:19.914063 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 346/694] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:19 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:20.940091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:20.941442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:20.949097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.949831 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.950255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:20.950966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:20.951410 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:20.951852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:21.156487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:21.165781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:21.167203 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:21.173604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1c303d92-416c-45d8-a9f6-265a50895c9b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.237841 Sep 13 19:56:21.176268 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 349/695] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:20 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:22.208704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:22.210033 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:22.224649 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.225422 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.226059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.227182 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:22.227767 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:22.228132 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:22.493503 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:22.512863 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:22.518837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:22.520043 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1e08fed7-07b7-4635-8600-696dc7b2fb35 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.322936 Sep 13 19:56:22.520660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 347/696] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:22 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:23.562004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:23.564309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:23.574547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.575133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.575763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.576788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:23.577567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:23.577703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:23.732524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:23.742097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:23.743556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:23.744789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-80bd3d24-546f-4ebd-8607-14e3366db048 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1744 microversion: 2.20 time: 0.200742 Sep 13 19:56:23.745413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 350/697] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:23 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:24.789292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:24.790835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:24.804131 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.804949 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.805741 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:24.806686 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:24.807288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:24.807981 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:25.164273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:25.192932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:25.197579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:25.201059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d0829356-08f2-4ceb-a585-1b7d9709fd7a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1744 microversion: 2.20 time: 0.422731 Sep 13 19:56:25.203753 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 348/698] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:24 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1744 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:26.231262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:26.232077 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:26.249568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.250283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.252659 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.253708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:26.255410 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:26.257277 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:26.531224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:26.564464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:26.575843 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:26.577453 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4cd30606-9be2-4783-9559-49bf960816c4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.350397 Sep 13 19:56:26.602224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 351/699] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:26 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:56:26.986617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-bf568078-977a-4b3a-b0bb-7df0ba2f77a4 req-af7f817f-36d0-4c6d-9492-95316c8ce03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ea540-ddf5-48c4-80c4-74588ebb619c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7a4c05-de58-4ed4-9f0a-e663f9d680f9"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:27.008097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bf568078-977a-4b3a-b0bb-7df0ba2f77a4 req-af7f817f-36d0-4c6d-9492-95316c8ce03e service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:27.010744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bf568078-977a-4b3a-b0bb-7df0ba2f77a4 req-af7f817f-36d0-4c6d-9492-95316c8ce03e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:27.012526 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-bf568078-977a-4b3a-b0bb-7df0ba2f77a4 req-af7f817f-36d0-4c6d-9492-95316c8ce03e service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.025555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-bf568078-977a-4b3a-b0bb-7df0ba2f77a4 req-af7f817f-36d0-4c6d-9492-95316c8ce03e service nova] Creating event network-vif-plugged:dc7a4c05-de58-4ed4-9f0a-e663f9d680f9 for instance 410ea540-ddf5-48c4-80c4-74588ebb619c on hv-cinder-82880 Sep 13 19:56:27.031402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-bf568078-977a-4b3a-b0bb-7df0ba2f77a4 req-af7f817f-36d0-4c6d-9492-95316c8ce03e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.422503 Sep 13 19:56:27.032585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 349/700] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:27.607384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:27.610136 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:27.618637 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:27.619481 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:27.621734 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.622878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:27.623589 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:27.624207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:27.815243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:27.829601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:27.836842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:27.839915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-923ab8c5-5c75-4973-8657-d2bd38f25835 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.238621 Sep 13 19:56:27.840864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 352/701] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:27 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:28.869235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:28.870717 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:28.878983 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.879746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.880203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:28.880979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:28.881398 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:28.882156 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:29.069268 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:29.077945 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:29.079712 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:29.080979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-123d2546-6068-4b48-b009-26dfa2213551 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.216195 Sep 13 19:56:29.081631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 350/702] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:28 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:30.108206 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:30.108844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:30.118093 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.118589 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.119218 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.120082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:30.120694 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:30.121296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:30.305976 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:30.315425 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:30.316942 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:30.318292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-211c43bb-86d4-44c4-bda7-790bfcef2899 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.214125 Sep 13 19:56:30.318863 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 353/703] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:30 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:56:31.349618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:31.350234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:31.358652 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.361017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.362139 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.363416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:31.364763 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:31.367950 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:31.374086 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:31.543443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:31.558834 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:31.560631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:31.563404 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-fdf0662c-253f-4848-b064-89848c20d2e6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.217677 Sep 13 19:56:31.564589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 351/704] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:31 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:32.590849 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:32.591450 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:32.600351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.600836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.601288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.602011 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.602458 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.602874 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.750957 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:32.751516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:32.764734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.765274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.765720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.766446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:32.766575 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:32.766879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:32.767304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:32.778143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:32.779569 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:32.780763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d644b336-fd94-4909-b2a8-f8f7234711d6 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.193892 Sep 13 19:56:32.781344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 354/705] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:32 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:32.796778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bc19fdde-4094-4bd5-9874-2924eef2bc92 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/ips" status: 200 len: 146 microversion: 2.1 time: 0.049839 Sep 13 19:56:32.798890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 352/706] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 19:56:32 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:33.806138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:33.806746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:33.814775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.815792 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.816501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.817516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:33.818049 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:33.819066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:33.845585 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.971039 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:33.979804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:33.981449 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:33.982910 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ef2414d0-f68c-4ba6-960c-da90fe7372ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.180948 Sep 13 19:56:33.983634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 355/707] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:33 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:34.318208 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d002b958-3de9-4a70-aaec-50a2f1c38fa9"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:34.321007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:34.327432 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.327923 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.328368 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.329131 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:34.329759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:34.330332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:34.675523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b23679d9-6cb0-4f52-8b84-89d340db51eb tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367275 Sep 13 19:56:34.676628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 353/708] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:56:34 2022] POST /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:35.009211 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:35.010561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:35.017505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.018317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.018749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.019484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:35.020115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:35.020600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:35.172475 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:35.182337 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:35.183807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:35.185358 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e4e12185-fd7b-4709-9ddb-bb440ae37742 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1739 microversion: 2.20 time: 0.180379 Sep 13 19:56:35.186133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 356/709] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:35 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:36.211634 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:36.212327 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:36.218956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.219434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.219866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.220550 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:36.221035 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:36.221445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:36.443316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:36.452395 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:36.453852 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:36.455029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d0bc4c39-02a9-4d6c-af63-fd00c48d39ef tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1721 microversion: 2.20 time: 0.248211 Sep 13 19:56:36.456338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 354/710] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:36 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:37.481076 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:37.481811 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:37.488523 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.489035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.489463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.490152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:37.490596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:37.491011 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:37.628606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:37.637375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:37.638817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:37.640000 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7a80c034-aaee-415a-9681-07a348db709e tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1721 microversion: 2.20 time: 0.163011 Sep 13 19:56:37.640575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 357/711] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:37 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:38.355055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-eab470db-c489-4438-9bf1-a12e9b7fc240 req-2e17b6e3-cbb1-4f00-8bf6-3abc0b52b089 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ea540-ddf5-48c4-80c4-74588ebb619c", "name": "network-vif-unplugged", "status": "completed", "tag": "dc7a4c05-de58-4ed4-9f0a-e663f9d680f9"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:38.363949 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:38.369681 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-eab470db-c489-4438-9bf1-a12e9b7fc240 req-2e17b6e3-cbb1-4f00-8bf6-3abc0b52b089 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.370580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-eab470db-c489-4438-9bf1-a12e9b7fc240 req-2e17b6e3-cbb1-4f00-8bf6-3abc0b52b089 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.371213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-eab470db-c489-4438-9bf1-a12e9b7fc240 req-2e17b6e3-cbb1-4f00-8bf6-3abc0b52b089 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.388469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-eab470db-c489-4438-9bf1-a12e9b7fc240 req-2e17b6e3-cbb1-4f00-8bf6-3abc0b52b089 service nova] Creating event network-vif-unplugged:dc7a4c05-de58-4ed4-9f0a-e663f9d680f9 for instance 410ea540-ddf5-48c4-80c4-74588ebb619c on hv-cinder-82880 Sep 13 19:56:38.394587 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-eab470db-c489-4438-9bf1-a12e9b7fc240 req-2e17b6e3-cbb1-4f00-8bf6-3abc0b52b089 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045232 Sep 13 19:56:38.395268 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 355/712] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:56:38.667463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:38.668082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:38.675225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.675715 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.676263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.677067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.677450 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.677880 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.811316 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:38.819644 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:38.821246 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:38.822446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-4706e829-c9a6-4196-b2e4-faa2e75fb3df tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1724 microversion: 2.20 time: 0.159326 Sep 13 19:56:38.823015 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 358/713] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:38 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:38.848258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "247f96d5-5b1f-48d0-9faa-8648e59ddbf3"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:38.850812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:38.857316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.857800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.858252 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:38.859019 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:38.859472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:38.859895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.154459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-abb24214-671c-4eee-bcc2-fbf51bd4a25b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310986 Sep 13 19:56:39.155071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 356/714] 10.222.0.18 () {62 vars in 1364 bytes} [Tue Sep 13 19:56:38 2022] POST /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 19:56:39.286946 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:39.287448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:39.289793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=45 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:39.295445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.295933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.296373 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.297107 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.297592 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.298017 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.567671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-789153e2-b866-4465-8e87-e436beb8866c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-volume_attachments/247f96d5-5b1f-48d0-9faa-8648e59ddbf3" status: 202 len: 0 microversion: 2.20 time: 0.284904 Sep 13 19:56:39.568372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 359/715] 10.222.0.18 () {60 vars in 1457 bytes} [Tue Sep 13 19:56:39 2022] DELETE /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-volume_attachments/247f96d5-5b1f-48d0-9faa-8648e59ddbf3 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:56:39.633479 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:39.634113 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:39.640340 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.640835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.641316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.645529 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.646425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.647019 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.680922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132127) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 19:56:39.753108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1de5adbe-2a30-474e-94f0-8a1e7ecfadd4 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "POST /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/action" status: 202 len: 0 microversion: 2.20 time: 0.123518 Sep 13 19:56:39.753966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 357/716] 10.222.0.18 () {62 vars in 1319 bytes} [Tue Sep 13 19:56:39 2022] POST /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:56:39.762114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:39.763351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:39.771015 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.771505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.771930 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.772647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:39.773124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:39.773544 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:39.918102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:39.926710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:39.930597 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:39.931865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c4094382-77cb-4154-8195-554a20c8e393 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1672 microversion: 2.20 time: 0.173645 Sep 13 19:56:39.933115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 360/717] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:39 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1672 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:40.960211 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:40.960838 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:40.967304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.967796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.968235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:40.968918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:40.969411 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:40.969833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:41.123234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:41.137145 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:41.139557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:41.141048 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-adb4bf32-a9c6-4f10-a63c-fe3040f8f74f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1672 microversion: 2.20 time: 0.186230 Sep 13 19:56:41.144938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 358/718] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:40 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:42.167195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:42.167880 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:42.175056 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.175855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.176405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.177273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.177822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.178485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.329317 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:42.333666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:42.341882 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.342550 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.343009 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.343708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.344169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.344593 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.381138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e009b611-ebc5-47ee-9413-9fc0741c3079 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056622 Sep 13 19:56:42.381966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 359/719] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:56:42 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:42.393929 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:42.394892 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:42.396716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:42.403544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.404361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.405169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.406073 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:42.406396 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:42.407251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:42.407542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:42.408056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:42.409339 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7aab733a-1db6-4af0-b973-b4e374fb1f22 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.246711 Sep 13 19:56:42.410464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 361/720] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:42 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:42.455678 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9b557735-9b7a-4d2e-8346-d5ef980614a6 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/d002b958-3de9-4a70-aaec-50a2f1c38fa9" status: 200 len: 194 microversion: 2.1 time: 0.066571 Sep 13 19:56:42.461684 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 360/721] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 13 19:56:42 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/d002b958-3de9-4a70-aaec-50a2f1c38fa9 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:43.437627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:43.439007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:43.449014 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.453603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.454145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.455502 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.456032 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.456526 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.701079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:43.716650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:43.720207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:43.724618 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b54dc9fe-c3a5-4a80-a8f8-5af26cc091d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.291431 Sep 13 19:56:43.727454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 362/722] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:43 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:43.887111 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93c3e50c-713e-4d2a-959c-49d1346dea82"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:43.891562 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:43.901457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.902405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.903252 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:43.904379 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:43.905158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:43.906108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.750360 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:44.751136 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:44.758001 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.758547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.758977 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.759678 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:44.760122 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:44.760537 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:44.921320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:44.928906 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:44.930348 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:44.931626 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8bf4a27a-d2af-44bc-b9b4-e4bdcad50b5f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.185055 Sep 13 19:56:44.932424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 363/723] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:44 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:45.956367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:45.956974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:45.964143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.965116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.965885 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:45.966793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:45.968342 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:45.969775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:46.148572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:46.159542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:46.161947 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:46.163690 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-765c0d16-781e-4a0c-9057-35e6ea848e5c tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.210999 Sep 13 19:56:46.164264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 364/724] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:45 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:56:47.189948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:47.190689 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:47.199098 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.199839 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.200455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.201785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:47.202387 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:47.203542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:47.370392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:47.378567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:47.380084 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:47.381367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-08590cff-389e-4d09-8502-b7a3ecf5c673 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.195600 Sep 13 19:56:47.381877 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 365/725] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:47 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:56:48.406484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:48.407080 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:48.414216 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.414696 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.415116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.415803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:48.416241 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:48.416658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:48.584707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:48.593581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:48.597089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:48.598440 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fd6fa275-6c4f-429f-aa39-115d6c66374b tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.195821 Sep 13 19:56:48.600931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 366/726] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:48 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:56:49.626978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:49.627677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:49.635758 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.636267 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.636736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.637492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:49.637949 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:49.638374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:49.826851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:49.834686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:49.836123 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:49.837349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-30c49b2f-085d-4332-a84b-0d2553f40194 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.215408 Sep 13 19:56:49.837921 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 367/727] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:49 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:56:50.864591 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:50.865491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:50.872480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.873080 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.873509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:50.874406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:50.875002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:50.875633 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:51.048349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:51.056878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:51.058347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:51.059513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0343a742-901a-4fbd-b798-62478db14f49 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.199657 Sep 13 19:56:51.060081 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 368/728] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:50 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:51.586721 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b2a42ea8-953e-478c-8fb0-038257feaf16 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "POST /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.710989 Sep 13 19:56:51.590916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 361/729] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:56:43 2022] POST /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments => generated 194 bytes in 7713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:52.085593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:52.086200 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:52.093697 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.094212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.094629 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.095445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:52.095922 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:52.096312 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:52.244713 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:52.246943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:52.254052 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:52.255462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:52.256724 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-811bf4ea-1dca-468c-87af-7c1fd88d8d7f tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.175205 Sep 13 19:56:52.257539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 369/730] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:52 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:53.288939 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:53.290182 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:53.300107 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.300743 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.301390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.302389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:53.302966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:53.303443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:53.323972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=9,nova_cell1:INSERT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:53.451548 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:53.460706 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:53.462833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:53.464128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7aee90ca-69a8-44a1-a3fa-a6bd47f1d3ab tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.183579 Sep 13 19:56:53.467907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 362/731] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:53 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:54.466129 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-cef4700a-8ea2-4410-a057-446766c0a2fd req-161a0918-df11-4c5b-996f-15c4a292e9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ea540-ddf5-48c4-80c4-74588ebb619c", "name": "network-vif-plugged", "status": "completed", "tag": "dc7a4c05-de58-4ed4-9f0a-e663f9d680f9"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:56:54.478538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cef4700a-8ea2-4410-a057-446766c0a2fd req-161a0918-df11-4c5b-996f-15c4a292e9bb service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.479267 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cef4700a-8ea2-4410-a057-446766c0a2fd req-161a0918-df11-4c5b-996f-15c4a292e9bb service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.480133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cef4700a-8ea2-4410-a057-446766c0a2fd req-161a0918-df11-4c5b-996f-15c4a292e9bb service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.492289 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:54.493355 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-cef4700a-8ea2-4410-a057-446766c0a2fd req-161a0918-df11-4c5b-996f-15c4a292e9bb service nova] Creating event network-vif-plugged:dc7a4c05-de58-4ed4-9f0a-e663f9d680f9 for instance 410ea540-ddf5-48c4-80c4-74588ebb619c on hv-cinder-82880 Sep 13 19:56:54.494761 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:54.498859 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-cef4700a-8ea2-4410-a057-446766c0a2fd req-161a0918-df11-4c5b-996f-15c4a292e9bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037955 Sep 13 19:56:54.499962 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 370/732] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:56:54.504076 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.504566 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.505029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.505775 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:54.506229 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:54.506657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:54.650630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:54.659189 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:54.660628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:54.661880 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3e3ef1ef-c424-4ce9-a2c5-b81b8c459321 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.175775 Sep 13 19:56:54.662677 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 363/733] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:54 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:55.692856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:55.693682 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:55.700619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.701140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.701566 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.702265 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:55.702700 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:55.703106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:55.840940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:55.849291 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:55.850730 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:55.851895 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9cff2611-0bb2-41a6-baa6-4515a80cc5d5 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.165870 Sep 13 19:56:55.852601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 371/734] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:55 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:56.877095 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:56.877710 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:56.884868 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.885818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.886365 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:56.887400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:56.887975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:56.888707 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:57.052310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:57.061288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:57.062719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:57.063918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9649dd99-4f8d-4f92-9afe-df5cc42fe364 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1730 microversion: 2.20 time: 0.190806 Sep 13 19:56:57.064502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 364/735] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:56 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:56:58.090158 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:56:58.090784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:56:58.098032 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:58.098526 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:58.098958 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:58.099657 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:56:58.100115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:56:58.100527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:56:58.244724 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:58.255677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:58.257864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:56:58.259526 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9491af25-a618-4b15-b0f2-37e254403b90 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1717 microversion: 2.20 time: 0.173044 Sep 13 19:56:58.260255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 372/736] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:56:58 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1717 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:57:00.254365 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:00.257062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:00.264366 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.264849 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.265417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.266118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.266565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.266977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.298256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a47b2465-a7e2-4307-ac7b-c93bf0f06538 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050284 Sep 13 19:57:00.298972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 365/737] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:00 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:00.448933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:00.449527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:00.456403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.456922 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.457367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.458204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.458662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.459078 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.489435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a6d47db3-552f-4070-880d-29adb2b2987d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/d002b958-3de9-4a70-aaec-50a2f1c38fa9" status: 200 len: 194 microversion: 2.1 time: 0.044538 Sep 13 19:57:00.490040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 373/738] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 13 19:57:00 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/d002b958-3de9-4a70-aaec-50a2f1c38fa9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:00.503610 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:00.504232 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:00.513895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.514615 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.515353 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.516683 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:00.517402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:00.517832 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:00.603692 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lazy-loading 'services' on Instance uuid 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:57:00.694058 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-cf2db9dd-8627-4434-b687-0dffb195ec78 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/d002b958-3de9-4a70-aaec-50a2f1c38fa9" status: 202 len: 0 microversion: 2.1 time: 0.195464 Sep 13 19:57:00.694916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 366/739] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:57:00 2022] DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/d002b958-3de9-4a70-aaec-50a2f1c38fa9 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:57:02.908795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:02.909454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:02.916613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.917140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.917578 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.918270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.918725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.919152 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.949956 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1c078e94-d95a-47a8-9626-babdcfeb4c3b tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/93c3e50c-713e-4d2a-959c-49d1346dea82" status: 200 len: 194 microversion: 2.1 time: 0.045165 Sep 13 19:57:02.950562 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 374/740] 10.222.0.18 () {58 vars in 1413 bytes} [Tue Sep 13 19:57:02 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/93c3e50c-713e-4d2a-959c-49d1346dea82 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:02.962677 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:02.963282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:02.970585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.971227 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.971665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:02.972364 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:02.972820 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:02.973285 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:03.057984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lazy-loading 'services' on Instance uuid 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:57:03.136941 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8713efb3-48f5-4d92-8792-ab4f8e0acce9 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/93c3e50c-713e-4d2a-959c-49d1346dea82" status: 202 len: 0 microversion: 2.1 time: 0.178621 Sep 13 19:57:03.137528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 367/741] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:57:02 2022] DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments/93c3e50c-713e-4d2a-959c-49d1346dea82 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:57:04.314953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:04.317204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:04.323997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.324475 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.324911 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.325612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.326062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.326480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.356344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c7f7eeba-681d-44c7-bfd3-eee7f1876655 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045410 Sep 13 19:57:04.356906 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 375/742] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:04 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:57:04.488427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:04.490853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:04.498103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.498559 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.498995 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.499690 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.500145 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.500601 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.531215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d85152db-c80b-4438-ac07-6a0250ebf7fe tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047130 Sep 13 19:57:04.531879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 368/743] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:57:04 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:57:04.597498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:04.597975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:04.604454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.605002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.605402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.606079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.606520 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.606938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.633447 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:57:04.719650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dadcc4b3-78c3-4abc-81bf-74b62c200130 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 204 len: 0 microversion: 2.1 time: 0.126127 Sep 13 19:57:04.720270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 376/744] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:57:04 2022] DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:57:04.730147 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:04.730764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:04.736904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.737427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.737852 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.738537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:04.738979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:04.739394 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:04.891778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:04.902909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b8c64204-2773-4d82-848b-412b5c240258 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1671 microversion: 2.1 time: 0.177809 Sep 13 19:57:04.903480 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 369/745] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:04 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:05.928011 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:05.928824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:05.935692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.936174 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.936604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:05.937320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:05.937766 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:05.938185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:06.076292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:06.088421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-18fbe56f-d993-47f9-a06e-ff8f699b59de tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1671 microversion: 2.1 time: 0.164533 Sep 13 19:57:06.089217 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 377/746] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:05 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:07.117714 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:07.118315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:07.125895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.126295 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.126732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.127455 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.127909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.128308 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.526783 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e60df169b5dc4aa59b5b0246544ef2b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ee86defec834a3c9613ca3dfa5e4350', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:07.535093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0fa2acfb-0905-4f41-a7e1-3823d471b8d4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 200 len: 1671 microversion: 2.1 time: 0.421624 Sep 13 19:57:07.536039 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 370/747] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:07 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 1671 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:07.932275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-371dfd5f-dce6-4662-9519-16985a194c0d req-f416a7b3-baf2-4bc6-954d-9bfd95e3fab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc", "name": "network-vif-deleted", "tag": "886e27a1-23fa-4ba2-b59c-67d88c830176"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:07.945663 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-371dfd5f-dce6-4662-9519-16985a194c0d req-f416a7b3-baf2-4bc6-954d-9bfd95e3fab9 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:07.946272 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-371dfd5f-dce6-4662-9519-16985a194c0d req-f416a7b3-baf2-4bc6-954d-9bfd95e3fab9 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:07.946743 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-371dfd5f-dce6-4662-9519-16985a194c0d req-f416a7b3-baf2-4bc6-954d-9bfd95e3fab9 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:07.958845 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-371dfd5f-dce6-4662-9519-16985a194c0d req-f416a7b3-baf2-4bc6-954d-9bfd95e3fab9 service nova] Creating event network-vif-deleted:886e27a1-23fa-4ba2-b59c-67d88c830176 for instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc on hv-cinder-82880 Sep 13 19:57:07.965048 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-371dfd5f-dce6-4662-9519-16985a194c0d req-f416a7b3-baf2-4bc6-954d-9bfd95e3fab9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036540 Sep 13 19:57:07.965784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 378/748] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:08.564121 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:08.565972 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:08.577145 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.578025 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.578807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.580059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:08.581166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:08.582158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:08.611502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] HTTP exception thrown: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Request method failure captured: Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc HTTP/1.1 Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN8G_3fKz5VQV1zivd1stc8QLHLxJqsPYkxc1NV0URWzJER2jnW7ZHz_Cb4gz5G-AKQdnCW8CZjm7nEWXTuL7U98fJ1PtoIpLcQ4qR0hLkurD_OJmYMp8vWHwM7GWBUs7PNmLIceE169TGxesPRJy1fy8FLcLqOqDTjey7fHIf3HXqQ Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:57:08.612833 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ee86defec834a3c9613ca3dfa5e4350", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}] Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: e60df169b5dc4aa59b5b0246544ef2b6 Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:08.614219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc'} Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:08.614985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:08.616350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:08.617600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Returning 404 to user: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:08.617600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-aaebd5e3-87f5-4448-ad12-3bb3ec31ae1d tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 404 len: 111 microversion: 2.1 time: 0.058431 Sep 13 19:57:08.617600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 371/749] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:08 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:57:08.625193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-38d9baac-0791-4428-8ce2-e2f31e4cabf4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '.version_select at 0x7f98b695ac10>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:08.645759 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-38d9baac-0791-4428-8ce2-e2f31e4cabf4 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-274692336" status: 202 len: 0 microversion: 2.1 time: 0.024882 Sep 13 19:57:08.646358 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 379/750] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 13 19:57:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-274692336 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:57:13.765807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:13.766383 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:13.768758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:13.774047 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.774635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.775064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.775752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.776201 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.776616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.791805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] HTTP exception thrown: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Request method failure captured: Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc HTTP/1.1 Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN8G_3fKz5VQV1zivd1stc8QLHLxJqsPYkxc1NV0URWzJER2jnW7ZHz_Cb4gz5G-AKQdnCW8CZjm7nEWXTuL7U98fJ1PtoIpLcQ4qR0hLkurD_OJmYMp8vWHwM7GWBUs7PNmLIceE169TGxesPRJy1fy8FLcLqOqDTjey7fHIf3HXqQ Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:57:13.793661 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ee86defec834a3c9613ca3dfa5e4350", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}] Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: e60df169b5dc4aa59b5b0246544ef2b6 Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.795294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc'} Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:13.796096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.797367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.798553 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Returning 404 to user: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:13.798553 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c404e1cf-af34-451c-9cf8-df41c6a6b20a tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 404 len: 111 microversion: 2.1 time: 0.033311 Sep 13 19:57:13.798553 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 372/751] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:57:13 2022] DELETE /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:57:13.803605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:13.804334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:13.806928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:13.812624 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.813123 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.813548 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.814236 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:13.814683 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:13.815101 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:13.829536 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] HTTP exception thrown: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Request method failure captured: Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc HTTP/1.1 Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN8G_3fKz5VQV1zivd1stc8QLHLxJqsPYkxc1NV0URWzJER2jnW7ZHz_Cb4gz5G-AKQdnCW8CZjm7nEWXTuL7U98fJ1PtoIpLcQ4qR0hLkurD_OJmYMp8vWHwM7GWBUs7PNmLIceE169TGxesPRJy1fy8FLcLqOqDTjey7fHIf3HXqQ Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:57:13.831177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ee86defec834a3c9613ca3dfa5e4350", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}] Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: e60df169b5dc4aa59b5b0246544ef2b6 Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.832702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc'} Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:13.833577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. Sep 13 19:57:13.834788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:13.835873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Returning 404 to user: Instance 1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:13.835873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1ef8612a-c815-4cd7-8eb6-161795e03f4c tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc" status: 404 len: 111 microversion: 2.1 time: 0.032822 Sep 13 19:57:13.835873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 380/752] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:13 2022] GET /compute/v2.1/servers/1a555e23-1dbf-4fa5-a26b-5a1c7ac486dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 19:57:14.981831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:14.982324 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:14.989269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.989744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.990148 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:14.990835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:14.991281 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:14.991699 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.005454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] HTTP exception thrown: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Request method failure captured: Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: DELETE /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 HTTP/1.1 Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN8G_3fKz5VQV1zivd1stc8QLHLxJqsPYkxc1NV0URWzJER2jnW7ZHz_Cb4gz5G-AKQdnCW8CZjm7nEWXTuL7U98fJ1PtoIpLcQ4qR0hLkurD_OJmYMp8vWHwM7GWBUs7PNmLIceE169TGxesPRJy1fy8FLcLqOqDTjey7fHIf3HXqQ Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:57:15.007020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ee86defec834a3c9613ca3dfa5e4350", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}] Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: e60df169b5dc4aa59b5b0246544ef2b6 Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.008475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'abd47672-e41a-48a6-a6ca-b89eb476d3a6'} Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:15.009442 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.010803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.011984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Returning 404 to user: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:15.011984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ef759c67-0924-4a14-91c3-fa88e96bed71 tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "DELETE /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 404 len: 111 microversion: 2.1 time: 0.030586 Sep 13 19:57:15.011984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 373/753] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:57:14 2022] DELETE /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:57:15.019650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:15.020389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] [instance: abd47672-e41a-48a6-a6ca-b89eb476d3a6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:15.027889 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.028454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.029435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.029614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:15.030101 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:15.030523 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:15.049541 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] HTTP exception thrown: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Request method failure captured: Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 HTTP/1.1 Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN8G_3fKz5VQV1zivd1stc8QLHLxJqsPYkxc1NV0URWzJER2jnW7ZHz_Cb4gz5G-AKQdnCW8CZjm7nEWXTuL7U98fJ1PtoIpLcQ4qR0hLkurD_OJmYMp8vWHwM7GWBUs7PNmLIceE169TGxesPRJy1fy8FLcLqOqDTjey7fHIf3HXqQ Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:57:15.051075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_3ee86defec834a3c9613ca3dfa5e4350", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/3ee86defec834a3c9613ca3dfa5e4350"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/3ee86defec834a3c9613ca3dfa5e4350"}]}] Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 3ee86defec834a3c9613ca3dfa5e4350 Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1886659848 Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: e60df169b5dc4aa59b5b0246544ef2b6 Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeTestJSON-1886659848-project Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.052503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'abd47672-e41a-48a6-a6ca-b89eb476d3a6'} Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:15.053327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. Sep 13 19:57:15.054500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:15.055591 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] Returning 404 to user: Instance abd47672-e41a-48a6-a6ca-b89eb476d3a6 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:15.055591 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-bac954dd-3c62-430b-9530-d91c6ff476ff tempest-AttachVolumeTestJSON-1886659848 tempest-AttachVolumeTestJSON-1886659848-project] 10.222.0.18 "GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6" status: 404 len: 111 microversion: 2.1 time: 0.039091 Sep 13 19:57:15.055591 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 381/754] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:15 2022] GET /compute/v2.1/servers/abd47672-e41a-48a6-a6ca-b89eb476d3a6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:57:27.401055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:27.409859 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:27.630539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c16e0647-fa7c-492f-9d2f-5813458c059e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: .version_select at 0x7f98b67d7d30>, body: {"keypair": {"name": "tempest-keypair-1828913661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqMiV30MU3X9zpIocgnrNtDxb4NVwZkIG3iHV5pAq3LdHlpF+SVPcWAjQf66u9FJK9eVnx/gC8AYaUs0iyPL6UVo01OLLW+SmTjTNgtFsqvgVZHNQq5kPrm28zTIPgSPg=="}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:27.659226 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-c16e0647-fa7c-492f-9d2f-5813458c059e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:57:27.672420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-c16e0647-fa7c-492f-9d2f-5813458c059e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:57:27.705628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c16e0647-fa7c-492f-9d2f-5813458c059e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.308485 Sep 13 19:57:27.711356 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 374/755] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:57:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:29.934575 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-610237830", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5fe14-9eff-496c-91ae-1a981d5e6e1b"}], "security_groups": [{"name": "tempest-securitygroup--1777015728"}], "key_name": "tempest-keypair-1828913661", "user_data": "}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:29.962298 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:29.963287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:30.160191 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] validate_networks() for [('a8c5fe14-9eff-496c-91ae-1a981d5e6e1b', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:57:30.893653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:57:30.894394 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:57:30.895016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:57:30.895584 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:57:30.896245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:57:30.914780 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.915511 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.916368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.919590 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:30.921212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:30.923606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:30.980393 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:57:30.989531 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:57:31.015722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:57:31.020660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:57:31.058181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.064670 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.090374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.091557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.094568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.096724 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.110544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.112590 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.208314 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2651b423-9eb7-4023-b68d-6988d05a4ab1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.278347 Sep 13 19:57:31.210088 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 382/756] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:57:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:57:31.234901 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ab316ddf-a974-4afb-ab1a-102221b46872 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.190994 Sep 13 19:57:31.235629 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-66047295-43d3-4a98-aeb4-8910ad632639 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.247416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-66047295-43d3-4a98-aeb4-8910ad632639 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.247950 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 375/757] 10.222.0.18 () {60 vars in 1343 bytes} [Tue Sep 13 19:57:31 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c/os-volume_attachments => generated 25 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:31.383222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.383810 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.396756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-66047295-43d3-4a98-aeb4-8910ad632639 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:31.398947 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.399925 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.400510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.403420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.404296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.405476 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.409301 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-66047295-43d3-4a98-aeb4-8910ad632639 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1241 microversion: 2.1 time: 0.191250 Sep 13 19:57:31.419600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 383/758] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:31 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1241 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:31.445875 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:57:31.581446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-caf74f41-79cd-4962-a635-1b998575c2cc tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 204 len: 0 microversion: 2.20 time: 0.202159 Sep 13 19:57:31.582811 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 376/759] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 19:57:31 2022] DELETE /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 19:57:31.599936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:31.599936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:31.619082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.619878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.620477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.621424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:31.622035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:31.622638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:31.949782 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:31.990034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:32.004562 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:32.007300 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5a613e63-425e-4954-8b80-f3a0a2a85a76 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.418967 Sep 13 19:57:32.008339 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 384/760] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:57:31 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 19:57:32.436227 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:32.437023 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:32.449614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.452096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.452570 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.456374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:32.456954 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:32.458580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:32.567168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:32.577698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b0bf2817-cd32-4865-8636-c63c884208cc tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1245 microversion: 2.1 time: 0.147007 Sep 13 19:57:32.578788 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 377/761] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:32 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1245 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:32.952844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3d232aab-a8c9-4b33-a2a5-ed1693536c1d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Action: 'create', calling method: .version_select at 0x7f98b698e700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-241128332", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEq8x5/aNkN/TYcfa/9ZEGQI+ZuH7T1RXFQP6JRSt7PmXsKH9tWaoLohadzSNNJf3eGoNNRWcZnvbA2OjyOBeImGdhd5BInxRudfuLnMallAPcm5fb/64csqFL7K3iaRiA=="}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:32.974302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-3d232aab-a8c9-4b33-a2a5-ed1693536c1d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:57:32.981027 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-3d232aab-a8c9-4b33-a2a5-ed1693536c1d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for user 4f63b1c74b4b4d34b33bef2b6267ecb2 and project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:57:33.011602 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3d232aab-a8c9-4b33-a2a5-ed1693536c1d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.240074 Sep 13 19:57:33.014101 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 385/762] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:57:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:33.038705 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:33.041108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:33.047821 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.048502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.049322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.050309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.050758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.051174 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.383794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:33.394096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:33.396700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:33.399921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b196d21a-0495-497d-9713-b4f1707db881 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1723 microversion: 2.20 time: 0.364815 Sep 13 19:57:33.414800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 378/763] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:57:33 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:57:33.611238 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:33.611924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:33.628769 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.629421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.629857 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.630579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:33.631025 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:33.631451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:33.714500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:33.725304 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a2361a89-c20f-4f75-aa46-70f72ae9825c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1293 microversion: 2.1 time: 0.118056 Sep 13 19:57:33.726547 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 386/764] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:33 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:34.431492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:34.434738 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:34.446766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.447698 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.458781 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.460033 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.461072 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.468258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.715382 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:34.737630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:34.749648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:34.750264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:34.759594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dbea9a6a35c6445a9ab76ee7278abda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd32f4615dd0450f8cc175e0bfcfc4a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:34.760984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f7061964-7c18-4ed8-b702-5bc0ee986d3d tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 200 len: 1655 microversion: 2.20 time: 0.335998 Sep 13 19:57:34.777013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.777013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.777013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.777013 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:34.777444 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:34.777444 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:34.777607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 379/765] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:57:34 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 1655 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 19:57:34.892654 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:34.906220 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-19828c5d-e9d7-4552-b13e-27c16bd870ce tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1299 microversion: 2.1 time: 0.155949 Sep 13 19:57:34.908061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 387/766] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:34 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:34.967000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-492d9cf0-eec8-4e0f-b624-f58b63d52a56 req-cc65d6e1-a1f3-4495-ac33-1e45655d967c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410ea540-ddf5-48c4-80c4-74588ebb619c", "name": "network-vif-deleted", "tag": "dc7a4c05-de58-4ed4-9f0a-e663f9d680f9"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:35.000075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-492d9cf0-eec8-4e0f-b624-f58b63d52a56 req-cc65d6e1-a1f3-4495-ac33-1e45655d967c service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.000998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-492d9cf0-eec8-4e0f-b624-f58b63d52a56 req-cc65d6e1-a1f3-4495-ac33-1e45655d967c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.002160 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-492d9cf0-eec8-4e0f-b624-f58b63d52a56 req-cc65d6e1-a1f3-4495-ac33-1e45655d967c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.021974 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-492d9cf0-eec8-4e0f-b624-f58b63d52a56 req-cc65d6e1-a1f3-4495-ac33-1e45655d967c service nova] Creating event network-vif-deleted:dc7a4c05-de58-4ed4-9f0a-e663f9d680f9 for instance 410ea540-ddf5-48c4-80c4-74588ebb619c on hv-cinder-82880 Sep 13 19:57:35.038114 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-492d9cf0-eec8-4e0f-b624-f58b63d52a56 req-cc65d6e1-a1f3-4495-ac33-1e45655d967c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072323 Sep 13 19:57:35.046385 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 380/767] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:35.797549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:35.799633 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:35.817888 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.818405 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.822417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.823516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.824354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.825061 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.857887 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] HTTP exception thrown: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Request method failure captured: Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c HTTP/1.1 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN7_Y_2pS-Od7gGSTDKXVha_IW_IdyBR7hyQwiRF6-rK94mSX2UVyZB_TMd6mJXO1iqWDXRzOHL-BTYPA97qxl4pDjv8t04TuQd3ZHpb8po-SJbOPZLjpw1rCkNw7vMPRae5yJU9-TEPuxFbm1Wa4lQcrJk2x-bgsRQ1FV1NU0E_iS4 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:57:35.866540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd32f4615dd0450f8cc175e0bfcfc4a1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}] Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: dbea9a6a35c6445a9ab76ee7278abda4 Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:35.868142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '410ea540-ddf5-48c4-80c4-74588ebb619c'} Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:35.868972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:35.870388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:35.874341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Returning 404 to user: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:35.874341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-809fcdcc-f80b-43e9-8bff-b1a115530d98 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 404 len: 111 microversion: 2.20 time: 0.077831 Sep 13 19:57:35.874341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 388/768] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:57:35 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:57:35.882798 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b2cade57-9655-4555-bbc5-48198c46ef5a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '.version_select at 0x7f98b67d79d0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:35.933921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b2cade57-9655-4555-bbc5-48198c46ef5a tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707351010" status: 204 len: 0 microversion: 2.20 time: 0.056626 Sep 13 19:57:35.934998 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:35.935158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 381/769] 10.222.0.18 () {60 vars in 1262 bytes} [Tue Sep 13 19:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1707351010 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 19:57:35.935763 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:35.948653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.952500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.953132 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:35.955861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:35.956533 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:35.957070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.225741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:36.239461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a7997938-9b52-403a-8202-c11291b640f6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1367 microversion: 2.1 time: 0.307893 Sep 13 19:57:36.241392 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 389/770] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:35 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:36.634874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-fdb10007-6f0c-46ec-8b86-089f0127238e req-1384e15e-92e8-4928-90d1-c0af58fb4eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f105c686-df5a-49ca-80cf-2ab5e2e2b6e6", "tag": "3484f3ef-636e-443d-ae7e-54d68c6127c6"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:36.647306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-fdb10007-6f0c-46ec-8b86-089f0127238e req-1384e15e-92e8-4928-90d1-c0af58fb4eb8 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:36.648922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-fdb10007-6f0c-46ec-8b86-089f0127238e req-1384e15e-92e8-4928-90d1-c0af58fb4eb8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:36.649612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-fdb10007-6f0c-46ec-8b86-089f0127238e req-1384e15e-92e8-4928-90d1-c0af58fb4eb8 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:36.661995 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-fdb10007-6f0c-46ec-8b86-089f0127238e req-1384e15e-92e8-4928-90d1-c0af58fb4eb8 service nova] Creating event network-changed:3484f3ef-636e-443d-ae7e-54d68c6127c6 for instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 on hv-cinder-82880 Sep 13 19:57:36.668290 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-fdb10007-6f0c-46ec-8b86-089f0127238e req-1384e15e-92e8-4928-90d1-c0af58fb4eb8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037080 Sep 13 19:57:36.669893 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 382/771] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:37.263711 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:37.264399 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:37.271384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.271871 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.272304 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.273035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:37.273487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:37.273907 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:37.417083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:37.425995 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f9aa6f48-be6c-4fba-879e-d2dafe603e03 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1367 microversion: 2.1 time: 0.166176 Sep 13 19:57:37.427442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 390/772] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:37 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:38.072031 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=4 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:38.077376 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:38.078003 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:38.084812 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.085363 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.085796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.086522 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.086982 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.087407 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.101509 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] HTTP exception thrown: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Request method failure captured: Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: DELETE /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c HTTP/1.1 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN7_Y_2pS-Od7gGSTDKXVha_IW_IdyBR7hyQwiRF6-rK94mSX2UVyZB_TMd6mJXO1iqWDXRzOHL-BTYPA97qxl4pDjv8t04TuQd3ZHpb8po-SJbOPZLjpw1rCkNw7vMPRae5yJU9-TEPuxFbm1Wa4lQcrJk2x-bgsRQ1FV1NU0E_iS4 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:57:38.103501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd32f4615dd0450f8cc175e0bfcfc4a1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}] Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: dbea9a6a35c6445a9ab76ee7278abda4 Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.105020 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '410ea540-ddf5-48c4-80c4-74588ebb619c'} Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:38.106012 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.107251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.109103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Returning 404 to user: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:38.109103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c45332dc-b5ea-4f4a-a3bf-2b8c3aaa1d45 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 404 len: 111 microversion: 2.20 time: 0.034515 Sep 13 19:57:38.109103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 383/773] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 19:57:38 2022] DELETE /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:57:38.115399 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:38.116449 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 410ea540-ddf5-48c4-80c4-74588ebb619c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:38.123440 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.123937 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.124367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.125141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.125591 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.126011 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.139558 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] HTTP exception thrown: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Request method failure captured: Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c HTTP/1.1 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN7_Y_2pS-Od7gGSTDKXVha_IW_IdyBR7hyQwiRF6-rK94mSX2UVyZB_TMd6mJXO1iqWDXRzOHL-BTYPA97qxl4pDjv8t04TuQd3ZHpb8po-SJbOPZLjpw1rCkNw7vMPRae5yJU9-TEPuxFbm1Wa4lQcrJk2x-bgsRQ1FV1NU0E_iS4 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:57:38.141143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd32f4615dd0450f8cc175e0bfcfc4a1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}] Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: dbea9a6a35c6445a9ab76ee7278abda4 Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.142606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '410ea540-ddf5-48c4-80c4-74588ebb619c'} Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:38.143347 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. Sep 13 19:57:38.144540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:38.146391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Returning 404 to user: Instance 410ea540-ddf5-48c4-80c4-74588ebb619c could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:38.146391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3004b2b1-0f74-48f5-88f1-1e8b127a03d3 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c" status: 404 len: 111 microversion: 2.20 time: 0.032018 Sep 13 19:57:38.146391 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 391/774] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:57:38 2022] GET /compute/v2.1/servers/410ea540-ddf5-48c4-80c4-74588ebb619c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:57:38.451051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:38.451667 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:38.457727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.458197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.458622 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.459306 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:38.459754 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:38.460192 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:38.602583 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:38.613665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6c37630b-0f85-4ce4-8f4d-a0bd9f9827e4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1367 microversion: 2.1 time: 0.166782 Sep 13 19:57:38.614259 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 384/775] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:38 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:39.302084 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:39.302657 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:39.309264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.309758 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.310192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.310898 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.311350 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.311771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.326567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] HTTP exception thrown: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Request method failure captured: Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 HTTP/1.1 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIN7_Y_2pS-Od7gGSTDKXVha_IW_IdyBR7hyQwiRF6-rK94mSX2UVyZB_TMd6mJXO1iqWDXRzOHL-BTYPA97qxl4pDjv8t04TuQd3ZHpb8po-SJbOPZLjpw1rCkNw7vMPRae5yJU9-TEPuxFbm1Wa4lQcrJk2x-bgsRQ1FV1NU0E_iS4 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:57:39.328156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd32f4615dd0450f8cc175e0bfcfc4a1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}] Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: dbea9a6a35c6445a9ab76ee7278abda4 Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.329739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '9fc2f361-c297-4a69-9898-d4d3cc310118'} Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:39.331004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.333620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.336094 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Returning 404 to user: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:39.336094 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d002ac10-7dbd-4d1e-a8b1-31f4b0625d72 tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 404 len: 111 microversion: 2.20 time: 0.031799 Sep 13 19:57:39.336094 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 392/776] 10.222.0.18 () {60 vars in 1280 bytes} [Tue Sep 13 19:57:39 2022] DELETE /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:57:39.342231 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:39.342877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] [instance: 9fc2f361-c297-4a69-9898-d4d3cc310118] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:39.350098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.350508 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.350942 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.351648 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.352098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.352523 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.366873 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] HTTP exception thrown: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Request method failure captured: Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 HTTP/1.1 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIN7_Y_2pS-Od7gGSTDKXVha_IW_IdyBR7hyQwiRF6-rK94mSX2UVyZB_TMd6mJXO1iqWDXRzOHL-BTYPA97qxl4pDjv8t04TuQd3ZHpb8po-SJbOPZLjpw1rCkNw7vMPRae5yJU9-TEPuxFbm1Wa4lQcrJk2x-bgsRQ1FV1NU0E_iS4 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 19:57:39.368457 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cd32f4615dd0450f8cc175e0bfcfc4a1", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cd32f4615dd0450f8cc175e0bfcfc4a1"}]}] Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: cd32f4615dd0450f8cc175e0bfcfc4a1 Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1409138527 Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: dbea9a6a35c6445a9ab76ee7278abda4 Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1409138527-project Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.370011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '9fc2f361-c297-4a69-9898-d4d3cc310118'} Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:57:39.370975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. Sep 13 19:57:39.372372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 19:57:39.373818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] Returning 404 to user: Instance 9fc2f361-c297-4a69-9898-d4d3cc310118 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:57:39.373818 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d00c1a0a-371d-4bc3-bfef-01c5b9b5f5cf tempest-AttachVolumeShelveTestJSON-1409138527 tempest-AttachVolumeShelveTestJSON-1409138527-project] 10.222.0.18 "GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118" status: 404 len: 111 microversion: 2.20 time: 0.032099 Sep 13 19:57:39.374201 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 385/777] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Sep 13 19:57:39 2022] GET /compute/v2.1/servers/9fc2f361-c297-4a69-9898-d4d3cc310118 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 19:57:39.636262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:39.637607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:39.644492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.645569 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.646012 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.646804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:39.647303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:39.647890 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:39.830756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:39.840145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-99f17f76-be73-4a0e-983d-0942ff81813b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1367 microversion: 2.1 time: 0.208210 Sep 13 19:57:39.840746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 393/778] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:39 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:40.872752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:40.874486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:40.883986 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.884612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.886217 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:40.887162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:40.888296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:40.888751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.063279 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:41.071676 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-827f9303-5841-4f36-a253-c8b4fa848a44 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1367 microversion: 2.1 time: 0.212568 Sep 13 19:57:41.072267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 386/779] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:40 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:41.311620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-cf1121ee-5316-47fe-ba77-1b86d1859f20 req-eb1c3695-2eb0-4d78-9829-db293c2ac168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f105c686-df5a-49ca-80cf-2ab5e2e2b6e6", "name": "network-vif-plugged", "status": "completed", "tag": "3484f3ef-636e-443d-ae7e-54d68c6127c6"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:41.321623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:41.324505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cf1121ee-5316-47fe-ba77-1b86d1859f20 req-eb1c3695-2eb0-4d78-9829-db293c2ac168 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:41.325258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cf1121ee-5316-47fe-ba77-1b86d1859f20 req-eb1c3695-2eb0-4d78-9829-db293c2ac168 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:41.325690 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cf1121ee-5316-47fe-ba77-1b86d1859f20 req-eb1c3695-2eb0-4d78-9829-db293c2ac168 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:41.342349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-cf1121ee-5316-47fe-ba77-1b86d1859f20 req-eb1c3695-2eb0-4d78-9829-db293c2ac168 service nova] Creating event network-vif-plugged:3484f3ef-636e-443d-ae7e-54d68c6127c6 for instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 on hv-cinder-82880 Sep 13 19:57:41.351461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-cf1121ee-5316-47fe-ba77-1b86d1859f20 req-eb1c3695-2eb0-4d78-9829-db293c2ac168 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043431 Sep 13 19:57:41.352476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 394/780] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:42.095332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:42.096004 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:42.103350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.104082 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.104521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:42.105327 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:42.105821 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:42.106250 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:42.308331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:42.316804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5245d249-9a52-48b2-a503-fc6719475ab7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1367 microversion: 2.1 time: 0.225854 Sep 13 19:57:42.318560 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 387/781] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:42 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:43.339239 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=12 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:43.344178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:43.345146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:43.352103 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.352598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.353055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.353861 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.354429 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.354848 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.507746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:43.516116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a9e5f819-0afb-409e-8eea-41613a686a5b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1556 microversion: 2.1 time: 0.178587 Sep 13 19:57:43.516707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 395/782] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:43 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1556 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:43.538669 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:43.539171 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:43.546425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.547157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.547752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.548688 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:43.549427 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:43.550041 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:43.649425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1d09e642-4e50-43b2-b8a9-9b84e9f4f898 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114645 Sep 13 19:57:43.650038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 388/783] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 19:57:43 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:44.691330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-1b61f3c7-31b0-4a45-a452-668632ebf0d4 req-d40a0fb7-5a24-4e0a-a005-cafc34893ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f105c686-df5a-49ca-80cf-2ab5e2e2b6e6", "tag": "3484f3ef-636e-443d-ae7e-54d68c6127c6"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:44.710890 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1b61f3c7-31b0-4a45-a452-668632ebf0d4 req-d40a0fb7-5a24-4e0a-a005-cafc34893ce4 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:44.711784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1b61f3c7-31b0-4a45-a452-668632ebf0d4 req-d40a0fb7-5a24-4e0a-a005-cafc34893ce4 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:44.712455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1b61f3c7-31b0-4a45-a452-668632ebf0d4 req-d40a0fb7-5a24-4e0a-a005-cafc34893ce4 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:44.724847 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-1b61f3c7-31b0-4a45-a452-668632ebf0d4 req-d40a0fb7-5a24-4e0a-a005-cafc34893ce4 service nova] Creating event network-changed:3484f3ef-636e-443d-ae7e-54d68c6127c6 for instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 on hv-cinder-82880 Sep 13 19:57:44.730077 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-1b61f3c7-31b0-4a45-a452-668632ebf0d4 req-d40a0fb7-5a24-4e0a-a005-cafc34893ce4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042730 Sep 13 19:57:44.731178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 396/784] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:45.998841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-63af7d4a-7c2f-4bd6-a035-1da8bfea7663 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b682df70>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:46.048054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-63af7d4a-7c2f-4bd6-a035-1da8bfea7663 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/95aa6877-d869-4d4c-9062-fad4992d67fd" status: 200 len: 350 microversion: 2.1 time: 0.053777 Sep 13 19:57:46.048623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 389/785] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:57:45 2022] GET /compute/v2.1/os-volumes/95aa6877-d869-4d4c-9062-fad4992d67fd => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:47.409542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a5092b29-23c1-4e19-9b96-a9d7a01e97c4 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b698e550>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:47.457205 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a5092b29-23c1-4e19-9b96-a9d7a01e97c4 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/f73afd12-3744-4c77-8f67-be9652c82b96" status: 200 len: 350 microversion: 2.1 time: 0.052345 Sep 13 19:57:47.457854 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 397/786] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:57:47 2022] GET /compute/v2.1/os-volumes/f73afd12-3744-4c77-8f67-be9652c82b96 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:48.810624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7bb11df7-e00d-4308-98fd-2de6b9edb1a2 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b6ae41f0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:48.859438 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7bb11df7-e00d-4308-98fd-2de6b9edb1a2 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/e4d5986f-94b7-41c0-8e2d-6b698f31209c" status: 200 len: 351 microversion: 2.1 time: 0.053524 Sep 13 19:57:48.860010 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 390/787] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 19:57:48 2022] GET /compute/v2.1/os-volumes/e4d5986f-94b7-41c0-8e2d-6b698f31209c => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:48.874073 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-61136ce3-d1e9-4368-b4f7-4eee789e59a8 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b6908d30>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:48.956495 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-61136ce3-d1e9-4368-b4f7-4eee789e59a8 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086882 Sep 13 19:57:48.957133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 398/788] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Sep 13 19:57:48 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:48.971512 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c40017f8-959c-4724-b7c8-34186c0dcf24 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b6adc1f0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.054995 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c40017f8-959c-4724-b7c8-34186c0dcf24 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087268 Sep 13 19:57:49.055566 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 391/789] 10.222.0.18 () {58 vars in 1149 bytes} [Tue Sep 13 19:57:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:49.069529 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b1f6f0ff-a7eb-4878-890d-90fb53a68eb2 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b692c940>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.152363 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b1f6f0ff-a7eb-4878-890d-90fb53a68eb2 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086654 Sep 13 19:57:49.152945 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 399/790] 10.222.0.18 () {58 vars in 1134 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:49.167029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9f18ad74-a637-4653-9d98-f0a4b865dee1 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b682db80>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.248228 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9f18ad74-a637-4653-9d98-f0a4b865dee1 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085365 Sep 13 19:57:49.248815 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 392/791] 10.222.0.18 () {58 vars in 1167 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:49.262933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9cb846a3-81eb-4462-be7b-e3fbd83ccb3c tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b69083a0>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.349242 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9cb846a3-81eb-4462-be7b-e3fbd83ccb3c tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090048 Sep 13 19:57:49.359180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 400/792] 10.222.0.18 () {58 vars in 1170 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:57:49.364680 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ee9a0f95-5106-4d22-96e8-36975c8ae9fa tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b6b37c10>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.446913 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ee9a0f95-5106-4d22-96e8-36975c8ae9fa tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086053 Sep 13 19:57:49.447498 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 393/793] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:49.461234 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1fd7496c-c71a-490c-a4e3-b5e92c6e0fb9 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b695a940>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.542667 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1fd7496c-c71a-490c-a4e3-b5e92c6e0fb9 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085136 Sep 13 19:57:49.543241 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 401/794] 10.222.0.18 () {58 vars in 1188 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:49.556713 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9b53c421-6561-4f86-9fe1-9280c3bedd50 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] Calling method '.version_select at 0x7f98b6ba4160>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:49.643180 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9b53c421-6561-4f86-9fe1-9280c3bedd50 tempest-VolumesTestJSON-1731469029 tempest-VolumesTestJSON-1731469029-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090181 Sep 13 19:57:49.643865 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 394/795] 10.222.0.18 () {58 vars in 1155 bytes} [Tue Sep 13 19:57:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:50.609892 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1984105826", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241128332", "security_groups": [{"name": "tempest-secgroup-smoke-645998509"}], "block_device_mapping_v2": [{"uuid": "46fd5c26-4e8f-4d06-86b9-7771437ab6c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0c886c7-ba72-4804-b43b-07a5caf41674"}]}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:50.726878 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] validate_networks() for [('b0c886c7-ba72-4804-b43b-07a5caf41674', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:57:51.124212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:57:51.124606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:57:51.125117 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:57:51.125545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:57:51.125948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:57:51.135613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.136150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.136572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.137545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:51.137953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:51.138424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:51.156593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:57:51.160502 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for user 4f63b1c74b4b4d34b33bef2b6267ecb2 and project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:57:51.220110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:57:51.222381 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46fd5c26-4e8f-4d06-86b9-7771437ab6c4',volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:57:51.360953 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5724f7c4-4894-4456-8724-6ec11ee39797 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.755411 Sep 13 19:57:51.361602 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 402/796] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:57:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:57:51.373980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1815dc4b-b349-408c-a8c7-c0d5280d48af tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:51.374962 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1815dc4b-b349-408c-a8c7-c0d5280d48af tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:51.430831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1815dc4b-b349-408c-a8c7-c0d5280d48af tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:51.438134 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1815dc4b-b349-408c-a8c7-c0d5280d48af tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1094 microversion: 2.1 time: 0.068968 Sep 13 19:57:51.438704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 395/797] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:51 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:52.461600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:52.462272 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:52.470830 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.471292 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.471736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.472432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:52.472869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:52.473798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:52.540185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:52.549549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-98124bad-cd67-4567-b236-991500160260 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1200 microversion: 2.1 time: 0.092014 Sep 13 19:57:52.557545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 403/798] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:52 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1200 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:53.574984 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:53.575585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:53.579088 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:53.583841 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.584319 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.584741 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.585465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:53.585907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:53.586320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:53.818935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:53.827389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-590c1c69-5db3-446e-b00b-fd029a40aa9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.257681 Sep 13 19:57:53.827918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 396/799] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:53 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:54.083793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-8a6a0fd7-88e0-4706-9899-c6ba7b55d876 req-0dd271bc-cf47-4b04-8a64-350702881eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29fad67-f6ab-422e-9cb7-549c00245204", "tag": "08fce2d6-c1d8-4084-84de-00dd8276d9fb"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:57:54.095569 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-8a6a0fd7-88e0-4706-9899-c6ba7b55d876 req-0dd271bc-cf47-4b04-8a64-350702881eb1 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.096117 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-8a6a0fd7-88e0-4706-9899-c6ba7b55d876 req-0dd271bc-cf47-4b04-8a64-350702881eb1 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.097226 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-8a6a0fd7-88e0-4706-9899-c6ba7b55d876 req-0dd271bc-cf47-4b04-8a64-350702881eb1 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.110543 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-8a6a0fd7-88e0-4706-9899-c6ba7b55d876 req-0dd271bc-cf47-4b04-8a64-350702881eb1 service nova] Creating event network-changed:08fce2d6-c1d8-4084-84de-00dd8276d9fb for instance d29fad67-f6ab-422e-9cb7-549c00245204 on hv-cinder-82880 Sep 13 19:57:54.117498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-8a6a0fd7-88e0-4706-9899-c6ba7b55d876 req-0dd271bc-cf47-4b04-8a64-350702881eb1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037090 Sep 13 19:57:54.118119 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 404/800] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:57:54.850733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:54.851418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:54.858330 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.858892 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.859435 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:54.860203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:54.860854 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:54.861360 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:55.013065 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:55.022011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c34ed31d-8be7-4aaa-89a8-b69be6f9e18d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.175053 Sep 13 19:57:55.022605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 397/801] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:54 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:57:56.046633 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:56.047579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:56.054076 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.054573 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.055006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.055784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:56.056165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:56.056648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:56.229785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:56.238284 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f5f94ef1-10d3-48d2-b814-db8260850811 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.196473 Sep 13 19:57:56.238879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 405/802] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:56 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:57.261425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:57.262101 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:57.268966 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.269690 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.270118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.270823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:57.271254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:57.271726 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:57.417719 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:57.426591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1ff7615b-214c-4bba-84e6-342d8c918634 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.168691 Sep 13 19:57:57.427198 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 398/803] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:57 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:58.450182 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:58.450796 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:58.457955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.458469 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.458908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.459641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:58.460194 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:58.460622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:58.601837 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:58.609962 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f737b2eb-d31d-46df-9f92-0a37410e7601 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.163714 Sep 13 19:57:58.610558 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 406/804] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:58 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:57:59.632780 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:57:59.633508 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:57:59.636008 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:59.642195 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.642654 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.643085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.643797 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:57:59.644395 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:57:59.644836 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:57:59.795102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:57:59.803313 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9fb7bbee-9b42-4f2f-a83c-6a399f766dfa tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.174457 Sep 13 19:57:59.803983 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 399/805] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:57:59 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:00.827117 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:00.827807 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:00.830352 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:00.836147 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:00.836644 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:00.837330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:00.838054 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:00.838654 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:00.839190 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:00.843089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=77 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:00.983614 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:00.992069 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-bd86dd99-e2ba-4b2e-8290-1d55f540562c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.168934 Sep 13 19:58:00.992877 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 407/806] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:00 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:02.015420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:02.016133 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:02.018585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:02.024563 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.025657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.025657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.026540 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:02.027052 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:02.027536 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:02.171903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:02.179948 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dda295ff-4ed5-446b-a5c7-07b255b05610 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.168704 Sep 13 19:58:02.180484 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 400/807] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:02 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:03.203914 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:03.204536 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:03.207080 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:03.208022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:03.215263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.215761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.216193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.216912 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.217381 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.217806 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.355969 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:03.365113 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d3912088-200a-4c01-90c0-d2b82c190ae4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.165009 Sep 13 19:58:03.365966 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 408/808] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:03 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:03.370998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-9e7aa5b9-7123-480b-9df8-31dccb5ffe8f req-3bc6e9dc-ba5e-40c5-892c-dbcc7437bc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29fad67-f6ab-422e-9cb7-549c00245204", "name": "network-vif-plugged", "status": "completed", "tag": "08fce2d6-c1d8-4084-84de-00dd8276d9fb"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:03.381714 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-9e7aa5b9-7123-480b-9df8-31dccb5ffe8f req-3bc6e9dc-ba5e-40c5-892c-dbcc7437bc7a service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:03.382227 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-9e7aa5b9-7123-480b-9df8-31dccb5ffe8f req-3bc6e9dc-ba5e-40c5-892c-dbcc7437bc7a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:03.382633 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-9e7aa5b9-7123-480b-9df8-31dccb5ffe8f req-3bc6e9dc-ba5e-40c5-892c-dbcc7437bc7a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:03.395671 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-9e7aa5b9-7123-480b-9df8-31dccb5ffe8f req-3bc6e9dc-ba5e-40c5-892c-dbcc7437bc7a service nova] Creating event network-vif-plugged:08fce2d6-c1d8-4084-84de-00dd8276d9fb for instance d29fad67-f6ab-422e-9cb7-549c00245204 on hv-cinder-82880 Sep 13 19:58:03.401610 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-9e7aa5b9-7123-480b-9df8-31dccb5ffe8f req-3bc6e9dc-ba5e-40c5-892c-dbcc7437bc7a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034793 Sep 13 19:58:03.402225 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 401/809] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:04.389865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:04.390856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:04.398140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.398638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.399067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.399769 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:04.400212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:04.400628 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:04.560110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:04.569678 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-074fbc4a-7714-49e9-9600-16b8343cb99d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1265 microversion: 2.1 time: 0.183945 Sep 13 19:58:04.570325 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 409/810] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:04 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:05.610053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:05.611173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:05.618948 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.619547 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.620093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.621197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.621728 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.622235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.817191 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:05.827618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-895742a0-e59e-42f1-91fa-74a31cc46afc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1451 microversion: 2.1 time: 0.223383 Sep 13 19:58:05.828591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 402/811] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:05 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1451 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:05.850257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:05.850993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:05.857963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.858493 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.858971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:05.859638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:05.860153 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:05.860492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:06.080950 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:06.090601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3ffade18-66b1-4e35-8886-b2f41aae0353 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1451 microversion: 2.1 time: 0.244165 Sep 13 19:58:06.091402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 410/812] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:05 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1451 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:08.450309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-fa456e68-6a40-49c0-a749-f805dbcbab41 req-26b65b24-09a9-4cc7-a430-20e3db139cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d29fad67-f6ab-422e-9cb7-549c00245204", "tag": "08fce2d6-c1d8-4084-84de-00dd8276d9fb"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:08.461588 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-fa456e68-6a40-49c0-a749-f805dbcbab41 req-26b65b24-09a9-4cc7-a430-20e3db139cac service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:08.462344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-fa456e68-6a40-49c0-a749-f805dbcbab41 req-26b65b24-09a9-4cc7-a430-20e3db139cac service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:08.462744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-fa456e68-6a40-49c0-a749-f805dbcbab41 req-26b65b24-09a9-4cc7-a430-20e3db139cac service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:08.475674 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-fa456e68-6a40-49c0-a749-f805dbcbab41 req-26b65b24-09a9-4cc7-a430-20e3db139cac service nova] Creating event network-changed:08fce2d6-c1d8-4084-84de-00dd8276d9fb for instance d29fad67-f6ab-422e-9cb7-549c00245204 on hv-cinder-82880 Sep 13 19:58:08.481830 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-fa456e68-6a40-49c0-a749-f805dbcbab41 req-26b65b24-09a9-4cc7-a430-20e3db139cac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035525 Sep 13 19:58:08.482679 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 403/813] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:20.753740 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:20.758324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:20.762140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=7 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:20.764149 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=23 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:20.780210 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:20.781125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:20.781846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:20.783456 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:20.784650 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:20.785751 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:20.836939 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-59c1d8d2-b65a-4704-b7da-fc6811b909c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/ips" status: 200 len: 149 microversion: 2.1 time: 0.087257 Sep 13 19:58:20.837848 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 411/814] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 19:58:20 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/ips => generated 149 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:22.393421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=9 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:22.394706 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=40 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:22.399473 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "468a9e84-b367-4a2e-9741-3d10cf32e0b1"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:22.402494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:22.411296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.411896 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.412339 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.413138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:22.413720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:22.414213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:22.798417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bf99cb47-785b-4675-8a35-b9c2502b98a1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406459 Sep 13 19:58:22.799515 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 404/815] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:58:22 2022] POST /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:30.612920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-61297b12-f262-44fc-bfb8-4d869551096a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: .version_select at 0x7f98b68c4f70>, body: {"keypair": {"name": "tempest-keypair-459097973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuXgd/iGuE2BZ74erL1P7/kmdepaBsewZDeWU3h3rv0/KeQPsWrhXqdt8wnYiBv6CbRbpcRtjXfIBC9YEPtyV6gPA/Yw6NkBduwsxc5bP/V0r55MJTbviJD5yUKta9XYQ=="}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:30.631895 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-61297b12-f262-44fc-bfb8-4d869551096a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:30.637170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-61297b12-f262-44fc-bfb8-4d869551096a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:30.665283 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-61297b12-f262-44fc-bfb8-4d869551096a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056242 Sep 13 19:58:30.666303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 412/816] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:58:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:32.435260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1921852410", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5fe14-9eff-496c-91ae-1a981d5e6e1b"}], "security_groups": [{"name": "tempest-securitygroup--1014619847"}], "key_name": "tempest-keypair-459097973", "user_data": "}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:32.446762 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:32.581567 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] validate_networks() for [('a8c5fe14-9eff-496c-91ae-1a981d5e6e1b', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:58:32.788377 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:33.350123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:58:33.351318 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:58:33.352080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:58:33.352596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:58:33.353203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:58:33.367179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.367697 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.368150 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.368948 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:33.369508 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:33.369924 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:33.390110 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:33.397453 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:33.419411 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:58:33.423540 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:58:33.504787 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c691d2bb-c9a9-4d9d-8942-be3534ccb54a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.073633 Sep 13 19:58:33.515262 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 405/817] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:58:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 19:58:33.518684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=4 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:33.539830 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1f2d218b-fb68-460f-97c2-06b9002cd538 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:33.540672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1f2d218b-fb68-460f-97c2-06b9002cd538 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:33.663140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1f2d218b-fb68-460f-97c2-06b9002cd538 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:33.675684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1f2d218b-fb68-460f-97c2-06b9002cd538 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1241 microversion: 2.1 time: 0.158453 Sep 13 19:58:33.676597 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 413/818] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:33 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:34.713101 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:34.714628 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:34.726236 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.727148 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.727886 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.729166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:34.730219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:34.731022 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:34.836811 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:34.852454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6fdf0749-8122-4ad8-89fa-6a9b8a0caeaa tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1293 microversion: 2.1 time: 0.146423 Sep 13 19:58:34.854026 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 406/819] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:34 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:35.893638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:35.895064 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:35.906610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.907441 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.908165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:35.909617 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:35.910307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:35.911051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:36.011412 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:36.024289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a628fdea-8548-412b-a03e-5c6ac023f4e2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1299 microversion: 2.1 time: 0.136095 Sep 13 19:58:36.025656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 414/820] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:35 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:37.071034 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:37.072418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:37.080804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.081942 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.082671 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.083794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:37.084627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:37.085695 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:37.989430 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:38.001332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e283d88d-fcca-4ff9-a17d-8d8f639743c9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1367 microversion: 2.1 time: 0.934306 Sep 13 19:58:38.018557 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 407/821] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:37 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1367 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:38.442384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-8106d0fc-50fe-4afd-be89-96d255bdc8af req-2ab8485d-b7c3-4b9c-a5ec-40824c01b25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f51bbf-5129-4092-b714-cf07c9d46e7e", "tag": "464b1848-69ac-48a7-a76f-7a486b9882dd"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:38.458127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-8106d0fc-50fe-4afd-be89-96d255bdc8af req-2ab8485d-b7c3-4b9c-a5ec-40824c01b25f service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:38.458605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-8106d0fc-50fe-4afd-be89-96d255bdc8af req-2ab8485d-b7c3-4b9c-a5ec-40824c01b25f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:38.459417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-8106d0fc-50fe-4afd-be89-96d255bdc8af req-2ab8485d-b7c3-4b9c-a5ec-40824c01b25f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:38.487954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-8106d0fc-50fe-4afd-be89-96d255bdc8af req-2ab8485d-b7c3-4b9c-a5ec-40824c01b25f service nova] Creating event network-changed:464b1848-69ac-48a7-a76f-7a486b9882dd for instance 07f51bbf-5129-4092-b714-cf07c9d46e7e on hv-cinder-82880 Sep 13 19:58:38.496030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-8106d0fc-50fe-4afd-be89-96d255bdc8af req-2ab8485d-b7c3-4b9c-a5ec-40824c01b25f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063476 Sep 13 19:58:38.498098 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 415/822] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:39.036173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:39.047084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:39.061097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.062357 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.063077 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.064307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:39.065166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:39.066174 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:39.357656 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:39.370137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-afe4219e-2cd8-4032-b87f-35969535a88f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1367 microversion: 2.1 time: 0.347963 Sep 13 19:58:39.371075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 408/823] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:39 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1367 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:40.403757 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:40.405308 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:40.413582 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.414506 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.415184 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.416525 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:40.417296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:40.417963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:40.643324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:40.654045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-85a6cc25-7796-44d6-b46b-f9427892f93e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1367 microversion: 2.1 time: 0.255088 Sep 13 19:58:40.654738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 416/824] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:40 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:41.696374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:41.699843 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:41.715260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.716685 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.717873 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.719434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:41.720569 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:41.721842 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:41.977715 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:41.992087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-470409d4-5f67-40d0-b485-09570e0c3b58 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1367 microversion: 2.1 time: 0.303128 Sep 13 19:58:41.993042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 409/825] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:41 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:43.034046 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:43.035478 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:43.044335 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.045016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.045692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.046610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.047161 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.047588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.216157 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:43.229571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-743df115-56b0-439a-8497-3fa48e7f4c82 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1367 microversion: 2.1 time: 0.199888 Sep 13 19:58:43.230163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 417/826] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:43 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:43.536089 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-730a2ab7-6811-40ff-adbf-731fb73a7787 req-8a142c63-9ed8-4861-a5bc-a018b76645d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f51bbf-5129-4092-b714-cf07c9d46e7e", "name": "network-vif-plugged", "status": "completed", "tag": "464b1848-69ac-48a7-a76f-7a486b9882dd"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:43.546634 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:43.548206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:43.561042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-730a2ab7-6811-40ff-adbf-731fb73a7787 req-8a142c63-9ed8-4861-a5bc-a018b76645d5 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:43.561808 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-730a2ab7-6811-40ff-adbf-731fb73a7787 req-8a142c63-9ed8-4861-a5bc-a018b76645d5 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:43.566862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-730a2ab7-6811-40ff-adbf-731fb73a7787 req-8a142c63-9ed8-4861-a5bc-a018b76645d5 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:43.597965 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-730a2ab7-6811-40ff-adbf-731fb73a7787 req-8a142c63-9ed8-4861-a5bc-a018b76645d5 service nova] Creating event network-vif-plugged:464b1848-69ac-48a7-a76f-7a486b9882dd for instance 07f51bbf-5129-4092-b714-cf07c9d46e7e on hv-cinder-82880 Sep 13 19:58:43.606817 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-730a2ab7-6811-40ff-adbf-731fb73a7787 req-8a142c63-9ed8-4861-a5bc-a018b76645d5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082203 Sep 13 19:58:43.608165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 410/827] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:44.270495 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:44.272647 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:44.287752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:44.292234 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.296290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.297329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.299011 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:44.300165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:44.300975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:44.604251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:44.615775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1e19fa26-1fcc-42d4-b664-0e33ae5d48be tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1367 microversion: 2.1 time: 0.355122 Sep 13 19:58:44.617349 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 418/828] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:44 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:58:45.659027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:45.661497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:45.674829 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.676233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.679582 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.681699 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:45.683307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:45.684483 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:45.963943 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:58:45.981205 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a9168877-0b71-4f8f-a69e-c6b8313b03e1 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1556 microversion: 2.1 time: 0.330970 Sep 13 19:58:45.998758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 411/829] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:58:45 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1556 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:58:46.020877 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:58:46.022170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:58:46.045570 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.051129 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.052198 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.053922 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:46.060111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:46.061176 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:46.239289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c6a84b50-7b56-4d3a-aa2f-7322ae375792 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.223739 Sep 13 19:58:46.240402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 419/830] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 19:58:46 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e/os-interface => generated 284 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:58:48.102177 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-f1cde7b7-8d3b-48e4-94e5-9d4663a3c6c6 req-b6582276-db8d-44da-bea6-0b9f42104b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07f51bbf-5129-4092-b714-cf07c9d46e7e", "tag": "464b1848-69ac-48a7-a76f-7a486b9882dd"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:48.125868 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-f1cde7b7-8d3b-48e4-94e5-9d4663a3c6c6 req-b6582276-db8d-44da-bea6-0b9f42104b4d service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:58:48.126469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-f1cde7b7-8d3b-48e4-94e5-9d4663a3c6c6 req-b6582276-db8d-44da-bea6-0b9f42104b4d service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:58:48.127048 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-f1cde7b7-8d3b-48e4-94e5-9d4663a3c6c6 req-b6582276-db8d-44da-bea6-0b9f42104b4d service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:58:48.144646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-f1cde7b7-8d3b-48e4-94e5-9d4663a3c6c6 req-b6582276-db8d-44da-bea6-0b9f42104b4d service nova] Creating event network-changed:464b1848-69ac-48a7-a76f-7a486b9882dd for instance 07f51bbf-5129-4092-b714-cf07c9d46e7e on hv-cinder-82880 Sep 13 19:58:48.151577 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-f1cde7b7-8d3b-48e4-94e5-9d4663a3c6c6 req-b6582276-db8d-44da-bea6-0b9f42104b4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053456 Sep 13 19:58:48.152715 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 412/831] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:58:51.543282 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0ceba88d-34a2-4fc2-ab93-556b19fad73e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Action: 'create', calling method: .version_select at 0x7f98b6a230d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1011659936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2002cgeCh6i+4djHz+NFcgZX/F/bws8LQAd9ZxNCqJsrsYL10WTrlvVIFlwccwtiFF5yZbhkLTa6fbEvAgQXxyghwmvhGnRxlSWqZtnekvFGAovNJFSEjjWRNT/qggmw=="}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:58:51.551447 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:51.573565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-0ceba88d-34a2-4fc2-ab93-556b19fad73e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Getting quotas for project 838511c93b924f118bcfc03ecfd870b2. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:58:51.580461 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-0ceba88d-34a2-4fc2-ab93-556b19fad73e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Getting quotas for user 9ca934350c71421cb644b3a380e96df2 and project 838511c93b924f118bcfc03ecfd870b2. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:58:51.615990 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0ceba88d-34a2-4fc2-ab93-556b19fad73e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.369106 Sep 13 19:58:51.617251 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 420/832] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:58:51 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:08.616722 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:08.617451 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=36 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:08.621938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-170421307", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1011659936", "security_groups": [{"name": "tempest-secgroup-smoke-767013118"}], "networks": [{"uuid": "9bab58a4-96da-4cd0-8527-bf12ee497be3"}], "block_device_mapping_v2": [{"uuid": "ca2cb0c0-b089-4ec4-993a-e9d862b144ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:08.758285 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] validate_networks() for [('9bab58a4-96da-4cd0-8527-bf12ee497be3', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:59:09.493654 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:59:09.494077 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:59:09.494567 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:59:09.494978 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:59:09.495390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:59:09.505207 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.505691 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.506129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.506858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:09.507310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:09.507732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:09.525370 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Getting quotas for project 838511c93b924f118bcfc03ecfd870b2. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:59:09.529653 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Getting quotas for user 9ca934350c71421cb644b3a380e96df2 and project 838511c93b924f118bcfc03ecfd870b2. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:59:09.591188 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:59:09.593481 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca2cb0c0-b089-4ec4-993a-e9d862b144ee',volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:59:09.732848 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-95a6f1e1-c3f8-4936-947f-0ca2013c62a2 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.117743 Sep 13 19:59:09.733933 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 413/833] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:59:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:59:09.746623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bf62d6bf-8181-4da8-a183-5ff32c40915d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:09.746623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-bf62d6bf-8181-4da8-a183-5ff32c40915d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:09.748679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=30 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:09.749762 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=4 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:09.750669 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:09.816294 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bf62d6bf-8181-4da8-a183-5ff32c40915d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:09.823689 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-bf62d6bf-8181-4da8-a183-5ff32c40915d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1088 microversion: 2.1 time: 0.082478 Sep 13 19:59:09.824541 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 421/834] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:09 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1088 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:10.848087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:10.848980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:10.855915 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.856426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.856867 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.857617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:10.858061 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:10.858505 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:10.930574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:10.944756 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1686ba98-21ef-413d-9623-fdf682a5172c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1186 microversion: 2.1 time: 0.100384 Sep 13 19:59:10.945472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 414/835] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:10 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1186 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:11.972701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:11.973446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:11.980594 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.981471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.981991 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:11.982913 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:11.983383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:11.983813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.135773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:12.144402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7fb19c77-b973-42af-b204-70ecabcd83a0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.176853 Sep 13 19:59:12.145023 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 422/836] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:11 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:12.618240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-916d19ac-4c77-481b-857b-4160c9f68663 req-5878d9c6-8ca2-4af5-9252-c92a7d1b620f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247f7a0a-2a2e-4b40-a96a-f31589cc5810", "tag": "e3d7babf-a6ba-404e-b3eb-a17c07fabe90"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:12.634711 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-916d19ac-4c77-481b-857b-4160c9f68663 req-5878d9c6-8ca2-4af5-9252-c92a7d1b620f service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:12.635426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-916d19ac-4c77-481b-857b-4160c9f68663 req-5878d9c6-8ca2-4af5-9252-c92a7d1b620f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:12.635988 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-916d19ac-4c77-481b-857b-4160c9f68663 req-5878d9c6-8ca2-4af5-9252-c92a7d1b620f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:12.651902 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-916d19ac-4c77-481b-857b-4160c9f68663 req-5878d9c6-8ca2-4af5-9252-c92a7d1b620f service nova] Creating event network-changed:e3d7babf-a6ba-404e-b3eb-a17c07fabe90 for instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 on hv-cinder-82880 Sep 13 19:59:12.657270 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-916d19ac-4c77-481b-857b-4160c9f68663 req-5878d9c6-8ca2-4af5-9252-c92a7d1b620f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043419 Sep 13 19:59:12.658211 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 415/837] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:13.169659 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:13.170415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:13.178407 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.178933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.179357 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.180071 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:13.180522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:13.181004 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:13.328829 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:13.337249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5d6c091f-a490-4b2d-a235-8563fa83d312 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.172895 Sep 13 19:59:13.337864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 423/838] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:13 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:14.371272 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:14.371991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:14.379067 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.379571 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.380002 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.380726 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:14.381205 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:14.381627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:14.547349 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:14.556764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-15dd78f2-2dc0-4224-b164-8bce96aba7b0 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.190763 Sep 13 19:59:14.557506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 416/839] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:14 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:15.583691 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:15.584857 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:15.595624 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.596113 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.596542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.597275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:15.597741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:15.598160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:15.750800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:15.763175 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-559edae6-f5fa-4c46-916d-8c5491914ad1 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.186324 Sep 13 19:59:15.763973 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 424/840] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:15 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:16.787371 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:16.788096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:16.795469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.795963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.796372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.797156 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:16.797638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:16.798051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:16.944553 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:16.961222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9f04b3a3-b273-43a2-ad60-548bfaf67ca7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.177858 Sep 13 19:59:16.961855 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 417/841] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:16 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:17.985240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:17.986222 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:17.994739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.995267 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.995851 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:17.996628 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:17.997151 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:17.997568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:18.154247 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:18.162728 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7787a2c8-eb4b-4be5-90dc-2e48cdd3363b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.182411 Sep 13 19:59:18.163329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 425/842] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:17 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:19.199930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:19.200540 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:19.207597 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.207872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.208620 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.209577 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:19.210029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:19.210479 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:19.365731 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:19.374134 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-be134aa9-8a22-4022-b975-8f672fdf4195 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.178074 Sep 13 19:59:19.374741 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 418/843] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:19 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:20.398176 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:20.399539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:20.406415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:20.408250 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.409106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.409505 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.410274 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:20.411075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:20.411706 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:20.569377 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:20.578302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1711238e-f2c7-4c11-8fc8-38c79eb3fa67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.184517 Sep 13 19:59:20.593455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 426/844] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:20 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:21.607718 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:21.608429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:21.610465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:21.611142 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:21.617977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.618459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.619015 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.619597 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.620181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.620447 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.697023 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-ce29a674-5c13-49ee-9200-905889778745 req-18399100-2cac-4252-918e-405369350570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247f7a0a-2a2e-4b40-a96a-f31589cc5810", "name": "network-vif-plugged", "status": "completed", "tag": "e3d7babf-a6ba-404e-b3eb-a17c07fabe90"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:21.711077 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-ce29a674-5c13-49ee-9200-905889778745 req-18399100-2cac-4252-918e-405369350570 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:21.711645 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-ce29a674-5c13-49ee-9200-905889778745 req-18399100-2cac-4252-918e-405369350570 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:21.712079 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-ce29a674-5c13-49ee-9200-905889778745 req-18399100-2cac-4252-918e-405369350570 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:21.724483 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-ce29a674-5c13-49ee-9200-905889778745 req-18399100-2cac-4252-918e-405369350570 service nova] Creating event network-vif-plugged:e3d7babf-a6ba-404e-b3eb-a17c07fabe90 for instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 on hv-cinder-82880 Sep 13 19:59:21.730368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-ce29a674-5c13-49ee-9200-905889778745 req-18399100-2cac-4252-918e-405369350570 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048512 Sep 13 19:59:21.731002 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 427/845] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:21.791853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:21.802946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5f4eb7ff-a83e-4142-8a2c-cce2763a0df3 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.199136 Sep 13 19:59:21.806138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 419/846] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:21 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:22.847660 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:22.848429 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:22.859443 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.861214 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.861976 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:22.863218 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:22.864070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:22.864866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:23.020804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:23.030266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-42c44849-e964-4cb3-b95e-1cbcc7b68297 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1259 microversion: 2.1 time: 0.188363 Sep 13 19:59:23.030956 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 428/847] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:22 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1259 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:24.054793 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.055602 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.070377 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.071399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.072264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.073803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.074618 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.075387 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.264011 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:24.273951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-24907792-c1cd-4b28-bbc2-9e4a948bc115 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1443 microversion: 2.1 time: 0.224000 Sep 13 19:59:24.274936 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 420/848] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1443 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:24.301075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.301778 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.311335 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.311838 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.312272 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.313091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.313543 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.313967 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.453375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:24.461691 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8880bef6-4ec5-4d33-b2e0-8022898ab455 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1443 microversion: 2.1 time: 0.164485 Sep 13 19:59:24.462295 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 429/849] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:24.642734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.643111 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.649558 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.650045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.650475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.651203 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.651654 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.652075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.683092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-66a37536-6bd2-4b0b-a644-d01a5fbaf331 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e/ips" status: 200 len: 149 microversion: 2.1 time: 0.044292 Sep 13 19:59:24.683919 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 421/850] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 19:59:24 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:24.698912 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "468a9e84-b367-4a2e-9741-3d10cf32e0b1"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:24.701971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.709939 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.710628 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.711058 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.711792 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.712241 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.712656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.828770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Invalid volume: volume 468a9e84-b367-4a2e-9741-3d10cf32e0b1 is already attached to instances: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: POST /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e/os-volume_attachments HTTP/1.1 Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 74 Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:59:24.832329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {"volumeAttachment": {"volumeId": "468a9e84-b367-4a2e-9741-3d10cf32e0b1"}} Sep 13 19:59:24.834539 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Invalid volume: volume 468a9e84-b367-4a2e-9741-3d10cf32e0b1 is already attached to instances: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'server_id': '07f51bbf-5129-4092-b714-cf07c9d46e7e', 'body': {'volumeAttachment': {'volumeId': '468a9e84-b367-4a2e-9741-3d10cf32e0b1'}}} Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 468a9e84-b367-4a2e-9741-3d10cf32e0b1 is already attached to instances: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:24.835400 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 468a9e84-b367-4a2e-9741-3d10cf32e0b1 is already attached to instances: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:24.837127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:24.838672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:24.838672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:59:24.838672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:59:24.838672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 468a9e84-b367-4a2e-9741-3d10cf32e0b1 is already attached to instances: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 Sep 13 19:59:24.838672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:24.838672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 400 to user: Invalid volume: volume 468a9e84-b367-4a2e-9741-3d10cf32e0b1 is already attached to instances: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:59:24.838672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e074d2bd-512a-4d4c-916b-52c4c2b20285 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140318 Sep 13 19:59:24.850631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:24.851548 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:24.851847 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 430/851] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 19:59:24 2022] POST /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e/os-volume_attachments => generated 174 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 13 19:59:24.862884 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.863740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.864487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.865741 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:24.866372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:24.866925 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:24.920456 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:59:25.021823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-815be15d-7958-43bf-8590-ceaa45ad0d0c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 204 len: 0 microversion: 2.1 time: 0.178463 Sep 13 19:59:25.022672 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 422/852] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:59:24 2022] DELETE /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 19:59:25.033143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:25.033143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:25.043741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.044433 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.044870 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.045641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:25.046093 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:25.046513 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:25.216031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:25.225833 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-89c3c10a-e3e8-46ee-880e-ee03bc2460c5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1681 microversion: 2.1 time: 0.198783 Sep 13 19:59:25.226428 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 431/853] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:25 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:26.250922 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:26.252351 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:26.259907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.260398 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.260830 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.261786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.262245 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.262751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.439692 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:26.453364 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c22e9e0c-e7b9-4384-985b-fc14578ed41b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1681 microversion: 2.1 time: 0.206890 Sep 13 19:59:26.454531 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 423/854] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:26 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1681 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:26.776817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-baf9be7b-4d87-4536-9fe7-b2b48b79bbb0 req-58815805-8d7f-4032-9061-efd2c904d753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247f7a0a-2a2e-4b40-a96a-f31589cc5810", "tag": "e3d7babf-a6ba-404e-b3eb-a17c07fabe90"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:26.796053 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-baf9be7b-4d87-4536-9fe7-b2b48b79bbb0 req-58815805-8d7f-4032-9061-efd2c904d753 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:26.796665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-baf9be7b-4d87-4536-9fe7-b2b48b79bbb0 req-58815805-8d7f-4032-9061-efd2c904d753 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:26.797235 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-baf9be7b-4d87-4536-9fe7-b2b48b79bbb0 req-58815805-8d7f-4032-9061-efd2c904d753 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:26.819211 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-baf9be7b-4d87-4536-9fe7-b2b48b79bbb0 req-58815805-8d7f-4032-9061-efd2c904d753 service nova] Creating event network-changed:e3d7babf-a6ba-404e-b3eb-a17c07fabe90 for instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 on hv-cinder-82880 Sep 13 19:59:26.828852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-baf9be7b-4d87-4536-9fe7-b2b48b79bbb0 req-58815805-8d7f-4032-9061-efd2c904d753 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058654 Sep 13 19:59:26.830815 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 432/855] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:27.483920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:27.485016 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:27.497750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.499251 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.500070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.501799 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:27.503100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:27.504190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:27.626967 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:27.639346 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e8224fb3-0c2e-4c73-ad8d-1b0497dbe51d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1613 microversion: 2.1 time: 0.162844 Sep 13 19:59:27.640792 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 424/856] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:27 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1613 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:28.678320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:28.679021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:28.685644 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.686146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.686583 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.687373 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.687933 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.688335 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.722718 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.723199 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.723646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.724092 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lazy-loading 'fault' on Instance uuid 07f51bbf-5129-4092-b714-cf07c9d46e7e {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:59:28.769393 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:28.780328 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7e785b7b-518d-4c68-81dc-c9b575b31816 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 200 len: 1331 microversion: 2.1 time: 0.106764 Sep 13 19:59:28.781006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 433/857] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:28 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:28.856555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-4822e910-4565-4f82-a6f9-2ae086ffdec6 req-5dd57b5f-b8ea-4ad3-b0a1-0385c4f604e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07f51bbf-5129-4092-b714-cf07c9d46e7e", "name": "network-vif-deleted", "tag": "464b1848-69ac-48a7-a76f-7a486b9882dd"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:28.869454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4822e910-4565-4f82-a6f9-2ae086ffdec6 req-5dd57b5f-b8ea-4ad3-b0a1-0385c4f604e3 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:28.869944 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4822e910-4565-4f82-a6f9-2ae086ffdec6 req-5dd57b5f-b8ea-4ad3-b0a1-0385c4f604e3 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:28.870381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4822e910-4565-4f82-a6f9-2ae086ffdec6 req-5dd57b5f-b8ea-4ad3-b0a1-0385c4f604e3 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:28.883624 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-4822e910-4565-4f82-a6f9-2ae086ffdec6 req-5dd57b5f-b8ea-4ad3-b0a1-0385c4f604e3 service nova] Creating event network-vif-deleted:464b1848-69ac-48a7-a76f-7a486b9882dd for instance 07f51bbf-5129-4092-b714-cf07c9d46e7e on hv-cinder-82880 Sep 13 19:59:28.889042 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-4822e910-4565-4f82-a6f9-2ae086ffdec6 req-5dd57b5f-b8ea-4ad3-b0a1-0385c4f604e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036343 Sep 13 19:59:28.889960 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 425/858] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 19:59:29.805091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.805675 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:29.813929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.814413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.814839 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.815530 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:29.815973 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:29.816386 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:29.830689 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e HTTP/1.1 Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:59:29.832367 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 19:59:29.834009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '07f51bbf-5129-4092-b714-cf07c9d46e7e'} Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:59:29.834928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 19:59:29.836420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:29.837819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:59:29.837819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ab554bb0-2bc2-4570-a70c-a34258b5dfe6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 404 len: 111 microversion: 2.1 time: 0.032768 Sep 13 19:59:29.837819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 434/859] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:29 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:59:29.844757 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-595b23ee-da66-4e2f-988c-e81b0c11d072 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '.version_select at 0x7f98b67c51f0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:29.867786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-595b23ee-da66-4e2f-988c-e81b0c11d072 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-459097973" status: 202 len: 0 microversion: 2.1 time: 0.027885 Sep 13 19:59:29.868726 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 426/860] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 13 19:59:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-459097973 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:59:30.582222 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.582712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.589091 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.589595 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.590031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.590707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.591144 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.591555 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.679708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lazy-loading 'services' on Instance uuid f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 19:59:30.761510 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3eb42b2a-ccea-4cb8-bac4-f2e337be78c4 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments/468a9e84-b367-4a2e-9741-3d10cf32e0b1" status: 202 len: 0 microversion: 2.1 time: 0.183236 Sep 13 19:59:30.762285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 435/861] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 19:59:30 2022] DELETE /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments/468a9e84-b367-4a2e-9741-3d10cf32e0b1 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:59:30.771308 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:30.773704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:30.781060 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.781514 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.781955 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.782638 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:30.783095 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:30.783510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:30.823800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5fb61d42-20f6-4e86-b652-3ab7423d60e6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056547 Sep 13 19:59:30.824420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 427/862] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:30 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:31.837744 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.840165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.847150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.847627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.848047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.848737 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.849219 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.849631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.881163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ec97b610-a6f9-4743-be93-8392cc5f423b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048417 Sep 13 19:59:31.881627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 436/863] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 19:59:31 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 19:59:31.950276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:31.950910 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:31.957884 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.958373 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.958805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.959512 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:31.960005 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:31.960614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:31.988764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 19:59:32.087219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f4949306-37b0-443f-8cb3-796b1b41eef6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 204 len: 0 microversion: 2.1 time: 0.140576 Sep 13 19:59:32.088506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 428/864] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 19:59:31 2022] DELETE /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 19:59:32.096316 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:32.096944 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:32.103048 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.103528 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.103955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.104658 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:32.105126 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:32.105538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:32.245357 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:32.254232 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b462574c-2610-4a5d-ad60-fc858e79fb02 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1681 microversion: 2.1 time: 0.161818 Sep 13 19:59:32.254816 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 437/865] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:32 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:33.278702 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:33.279445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:33.287434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.288000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.288463 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.289336 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:33.289930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:33.290500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:33.318538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:33.447137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:33.456235 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-26044a7f-5d0e-4dcf-a48c-b9a08628aa99 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1681 microversion: 2.1 time: 0.181736 Sep 13 19:59:33.456973 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 429/866] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:33 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:34.500351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:34.501237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:34.508416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.508942 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.509364 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.510075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.510518 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.510938 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.678126 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:34.687031 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-05502863-a5bf-4932-98ea-d03b9ea9ccf0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 200 len: 1681 microversion: 2.1 time: 0.190665 Sep 13 19:59:34.687636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 438/867] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:34 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:34.931834 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-8beb94d4-ea3b-4320-80f7-e364faf05173 req-f5bc7f63-456e-4322-b1f3-6ea044f43f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f105c686-df5a-49ca-80cf-2ab5e2e2b6e6", "name": "network-vif-deleted", "tag": "3484f3ef-636e-443d-ae7e-54d68c6127c6"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:34.943470 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-8beb94d4-ea3b-4320-80f7-e364faf05173 req-f5bc7f63-456e-4322-b1f3-6ea044f43f4b service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:34.946824 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-8beb94d4-ea3b-4320-80f7-e364faf05173 req-f5bc7f63-456e-4322-b1f3-6ea044f43f4b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:34.947273 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-8beb94d4-ea3b-4320-80f7-e364faf05173 req-f5bc7f63-456e-4322-b1f3-6ea044f43f4b service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:34.971293 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-8beb94d4-ea3b-4320-80f7-e364faf05173 req-f5bc7f63-456e-4322-b1f3-6ea044f43f4b service nova] Creating event network-vif-deleted:3484f3ef-636e-443d-ae7e-54d68c6127c6 for instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 on hv-cinder-82880 Sep 13 19:59:34.977346 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-8beb94d4-ea3b-4320-80f7-e364faf05173 req-f5bc7f63-456e-4322-b1f3-6ea044f43f4b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049001 Sep 13 19:59:34.978197 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 430/868] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:35.716625 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:35.717776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:35.729664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.730528 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.731275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.732601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:35.733436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:35.734247 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:35.760093 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 HTTP/1.1 Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 19:59:35.763322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 19:59:35.765504 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'f105c686-df5a-49ca-80cf-2ab5e2e2b6e6'} Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 19:59:35.766402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 19:59:35.768464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 19:59:35.770808 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 19:59:35.770808 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-89e99a13-6899-4a40-afe7-be70dfed0714 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 404 len: 111 microversion: 2.1 time: 0.056426 Sep 13 19:59:35.770808 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 439/869] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:35 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 19:59:35.782162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5e49ba4f-0369-4a3b-8077-9dbd92b77459 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '.version_select at 0x7f98b6ba4c10>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:35.812996 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5e49ba4f-0369-4a3b-8077-9dbd92b77459 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828913661" status: 202 len: 0 microversion: 2.1 time: 0.038383 Sep 13 19:59:35.813869 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 431/870] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 19:59:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1828913661 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 19:59:36.595653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dd0489a8-8066-431d-acc6-bd87f59e9cd8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: .version_select at 0x7f98b692c5e0>, body: {"keypair": {"name": "tempest-keypair-1256111561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdCQCnbqcmpo33Yz4iBYdamVlsuLl/HJqfBHnoyadF78U0GQc4cH9mmiO9ZV6vwA1cFFHC+VAKims0tm61ElnTwuX48+fBauVjY2rRDm+Ir4sa4O53h7cuVY6By5gDOVg=="}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:36.624241 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-dd0489a8-8066-431d-acc6-bd87f59e9cd8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:59:36.631596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-dd0489a8-8066-431d-acc6-bd87f59e9cd8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:59:36.666705 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dd0489a8-8066-431d-acc6-bd87f59e9cd8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078410 Sep 13 19:59:36.667485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 440/871] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 19:59:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:38.452858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1152847225", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5fe14-9eff-496c-91ae-1a981d5e6e1b"}], "security_groups": [{"name": "tempest-securitygroup--141779696"}], "key_name": "tempest-keypair-1256111561", "user_data": "}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:38.570209 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] validate_networks() for [('a8c5fe14-9eff-496c-91ae-1a981d5e6e1b', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 19:59:38.771941 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:38.995614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 19:59:38.996032 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 19:59:38.996502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 19:59:38.996924 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 19:59:38.997335 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 19:59:39.006987 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.007465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.007964 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.008701 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:39.009173 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:39.009587 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:39.028778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 19:59:39.034566 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 19:59:39.047578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 19:59:39.050637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 19:59:39.099855 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dae08f2e-9405-436c-81fb-1104a68d79a5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.652284 Sep 13 19:59:39.100511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 432/872] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 19:59:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 19:59:39.112128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ee852900-2bec-4885-95a3-ff602ae5f766 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:39.113070 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ee852900-2bec-4885-95a3-ff602ae5f766 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:39.196306 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ee852900-2bec-4885-95a3-ff602ae5f766 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:39.209062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ee852900-2bec-4885-95a3-ff602ae5f766 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1242 microversion: 2.1 time: 0.100507 Sep 13 19:59:39.210157 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 441/873] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:39 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1242 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:40.245069 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:40.245681 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:40.252693 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.253220 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.253633 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.254374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:40.254803 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:40.255229 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:40.332586 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:40.342526 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c3c0ff29-4eef-496c-8b28-008a4ccc56b6 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1294 microversion: 2.1 time: 0.102007 Sep 13 19:59:40.343533 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 433/874] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:40 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:41.369887 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:41.370739 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:41.373382 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:41.380627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.381178 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.381618 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.382338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:41.382908 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:41.383329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:41.387315 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:41.524860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:41.539752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-66ec03b6-92e2-4f7f-b35d-8aafc042780f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1367 microversion: 2.1 time: 0.173586 Sep 13 19:59:41.540713 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 442/875] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:41 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 19:59:42.011860 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-7663b9ad-7e7d-4623-83d8-a8fe610dffdd req-a1d1fdb0-d606-4306-89a2-4a9379d0fedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a9949c-a495-4069-8090-f8f8119bbc9c", "tag": "69633a0a-b2fb-48d9-bb4a-acf43ec54ce6"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:42.023493 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7663b9ad-7e7d-4623-83d8-a8fe610dffdd req-a1d1fdb0-d606-4306-89a2-4a9379d0fedc service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.023976 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7663b9ad-7e7d-4623-83d8-a8fe610dffdd req-a1d1fdb0-d606-4306-89a2-4a9379d0fedc service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.024604 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-7663b9ad-7e7d-4623-83d8-a8fe610dffdd req-a1d1fdb0-d606-4306-89a2-4a9379d0fedc service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.037616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-7663b9ad-7e7d-4623-83d8-a8fe610dffdd req-a1d1fdb0-d606-4306-89a2-4a9379d0fedc service nova] Creating event network-changed:69633a0a-b2fb-48d9-bb4a-acf43ec54ce6 for instance d7a9949c-a495-4069-8090-f8f8119bbc9c on hv-cinder-82880 Sep 13 19:59:42.042605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-7663b9ad-7e7d-4623-83d8-a8fe610dffdd req-a1d1fdb0-d606-4306-89a2-4a9379d0fedc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034428 Sep 13 19:59:42.043725 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 434/876] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:42.564377 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:42.565100 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:42.572246 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.572724 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.573180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.573886 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:42.574380 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:42.574795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:42.722726 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:42.736249 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b1be7ecc-4540-41b9-8d01-c5cdb417f56a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1367 microversion: 2.1 time: 0.176148 Sep 13 19:59:42.736983 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 443/877] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:42 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:43.761120 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:43.762079 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:43.769416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.769906 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.770350 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.771085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:43.771538 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:43.771956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:43.923102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:43.931430 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a45a16e7-23f9-46f3-ada1-362448712123 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1367 microversion: 2.1 time: 0.175120 Sep 13 19:59:43.932024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 435/878] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:43 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:44.956066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:44.956819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:44.963869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.964351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.964775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:44.965509 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:44.965958 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:44.966372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:45.104846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:45.115601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5ab87df3-c6c0-4c3c-9456-dbf6ff4c0539 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1367 microversion: 2.1 time: 0.163888 Sep 13 19:59:45.116182 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 444/879] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:44 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:46.139633 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:46.140280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:46.147649 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.148138 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.148576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.149328 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:46.149784 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:46.150214 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:46.322190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:46.330699 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4b03cc92-baac-43ec-9eba-838fd217b625 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1367 microversion: 2.1 time: 0.195188 Sep 13 19:59:46.331576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 436/880] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:46 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:47.354565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:47.355226 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:47.363157 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.363641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.364066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.364776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.365262 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.365680 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.506460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:47.514905 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-08668537-1d2b-47d5-adae-38d8e79bb0d7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1367 microversion: 2.1 time: 0.164369 Sep 13 19:59:47.515497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 445/881] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:47 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:47.807344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-cb29ad93-8ae9-4611-9d5c-82d7ed01c01c req-7b6474e3-c1d5-4a29-8b5f-5a8d2de9c15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a9949c-a495-4069-8090-f8f8119bbc9c", "name": "network-vif-plugged", "status": "completed", "tag": "69633a0a-b2fb-48d9-bb4a-acf43ec54ce6"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:47.818837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-cb29ad93-8ae9-4611-9d5c-82d7ed01c01c req-7b6474e3-c1d5-4a29-8b5f-5a8d2de9c15d service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:47.819543 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-cb29ad93-8ae9-4611-9d5c-82d7ed01c01c req-7b6474e3-c1d5-4a29-8b5f-5a8d2de9c15d service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:47.820169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-cb29ad93-8ae9-4611-9d5c-82d7ed01c01c req-7b6474e3-c1d5-4a29-8b5f-5a8d2de9c15d service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:47.833727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-cb29ad93-8ae9-4611-9d5c-82d7ed01c01c req-7b6474e3-c1d5-4a29-8b5f-5a8d2de9c15d service nova] Creating event network-vif-plugged:69633a0a-b2fb-48d9-bb4a-acf43ec54ce6 for instance d7a9949c-a495-4069-8090-f8f8119bbc9c on hv-cinder-82880 Sep 13 19:59:47.839256 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-cb29ad93-8ae9-4611-9d5c-82d7ed01c01c req-7b6474e3-c1d5-4a29-8b5f-5a8d2de9c15d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035711 Sep 13 19:59:47.839886 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 437/882] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:48.538631 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:48.539305 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:48.546709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.547219 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.547659 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.548364 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:48.548981 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:48.549403 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:48.690873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:48.699134 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a43962c0-4a5d-40aa-a006-d9611335297d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1367 microversion: 2.1 time: 0.164850 Sep 13 19:59:48.699745 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 446/883] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:48 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:49.721843 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.722971 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.729645 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:49.730916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:49.739418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.740043 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.740847 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.741215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.741215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.741215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.897767 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 19:59:49.907776 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2b36478e-f28d-482e-affb-6d3c70062654 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1556 microversion: 2.1 time: 0.187569 Sep 13 19:59:49.908447 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 438/884] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 19:59:49 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 19:59:49.932012 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 19:59:49.932597 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 19:59:49.934565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:49.940746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.941268 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.941768 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:49.942470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:49.942920 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:49.943340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:50.038197 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5d33a381-ced4-4343-a9d1-e8327067e474 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109765 Sep 13 19:59:50.039288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 447/885] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 19:59:49 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 19:59:51.102826 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-860b9e33-e442-4540-9cc6-5ef48704e596 req-27eb8dda-ee3b-43b2-9406-ca47f5dd28c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a9949c-a495-4069-8090-f8f8119bbc9c", "tag": "69633a0a-b2fb-48d9-bb4a-acf43ec54ce6"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 19:59:51.121407 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-860b9e33-e442-4540-9cc6-5ef48704e596 req-27eb8dda-ee3b-43b2-9406-ca47f5dd28c7 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 19:59:51.122257 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-860b9e33-e442-4540-9cc6-5ef48704e596 req-27eb8dda-ee3b-43b2-9406-ca47f5dd28c7 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 19:59:51.123136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-860b9e33-e442-4540-9cc6-5ef48704e596 req-27eb8dda-ee3b-43b2-9406-ca47f5dd28c7 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 19:59:51.145248 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-860b9e33-e442-4540-9cc6-5ef48704e596 req-27eb8dda-ee3b-43b2-9406-ca47f5dd28c7 service nova] Creating event network-changed:69633a0a-b2fb-48d9-bb4a-acf43ec54ce6 for instance d7a9949c-a495-4069-8090-f8f8119bbc9c on hv-cinder-82880 Sep 13 19:59:51.154843 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-860b9e33-e442-4540-9cc6-5ef48704e596 req-27eb8dda-ee3b-43b2-9406-ca47f5dd28c7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058608 Sep 13 19:59:51.155992 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 439/886] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 19:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:06.039849 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=11 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:06.041021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=33 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:06.048860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.050006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.062500 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.063357 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.064106 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.065438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.066259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.066994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.107655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:00:06.227267 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-74fa6a81-d4a5-4c90-937c-6b98b01f7bc4 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 204 len: 0 microversion: 2.1 time: 0.189064 Sep 13 20:00:06.228162 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 448/887] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:00:06 2022] DELETE /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:00:06.235156 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:06.236100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=36 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:06.241544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:06.242255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:06.250956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.251446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.251880 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.252616 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:06.253129 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:06.253568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:06.407991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:06.420871 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-28b5d80c-9c8b-47a3-aece-d251776dc103 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1575 microversion: 2.1 time: 0.187310 Sep 13 20:00:06.421643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 440/888] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:06 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:07.445971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:07.446817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:07.455083 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.455556 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.456040 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.456803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:07.457351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:07.457781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:07.631312 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:07.639948 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f95bb072-2113-4c96-bfac-e3d0eff6e09b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1575 microversion: 2.1 time: 0.198670 Sep 13 20:00:07.640798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 449/889] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:07 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1575 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:08.671230 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:08.672353 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:08.689406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.692049 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.692905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.694221 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:08.695056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:08.695808 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:08.791304 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:08.802281 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9f10ba5a-5025-422e-bb4c-138ed29d8d6b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1508 microversion: 2.1 time: 0.140864 Sep 13 20:00:08.802881 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 441/890] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:08 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1508 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:08.990686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-85de696a-b91d-4a99-9a9e-1bc11e175999 req-753e74b1-8942-4f37-8c92-aaffd53e1c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d29fad67-f6ab-422e-9cb7-549c00245204", "name": "network-vif-deleted", "tag": "08fce2d6-c1d8-4084-84de-00dd8276d9fb"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:09.007789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-85de696a-b91d-4a99-9a9e-1bc11e175999 req-753e74b1-8942-4f37-8c92-aaffd53e1c59 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.008421 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-85de696a-b91d-4a99-9a9e-1bc11e175999 req-753e74b1-8942-4f37-8c92-aaffd53e1c59 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.008944 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-85de696a-b91d-4a99-9a9e-1bc11e175999 req-753e74b1-8942-4f37-8c92-aaffd53e1c59 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.026003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-85de696a-b91d-4a99-9a9e-1bc11e175999 req-753e74b1-8942-4f37-8c92-aaffd53e1c59 service nova] Creating event network-vif-deleted:08fce2d6-c1d8-4084-84de-00dd8276d9fb for instance d29fad67-f6ab-422e-9cb7-549c00245204 on hv-cinder-82880 Sep 13 20:00:09.039823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-85de696a-b91d-4a99-9a9e-1bc11e175999 req-753e74b1-8942-4f37-8c92-aaffd53e1c59 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056072 Sep 13 20:00:09.041340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 450/891] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:09.839111 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:09.841845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:09.854697 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.855575 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.856362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.857786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.858630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.859411 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.928030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:09.928921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:09.929733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:09.930580 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lazy-loading 'fault' on Instance uuid d29fad67-f6ab-422e-9cb7-549c00245204 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:00:10.001080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:10.014204 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-3484b1d6-e434-4e6b-a1d2-abec9507f06e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 200 len: 1184 microversion: 2.1 time: 0.182639 Sep 13 20:00:10.015639 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 442/892] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:09 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 1184 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:11.053212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:11.053940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:11.060737 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.061266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.061773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.062497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.062943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.063334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.078451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] HTTP exception thrown: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Request method failure captured: Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 HTTP/1.1 Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCkk_OHYnd_4HehShJhcd6IaTcqjOBdULzudF7I9SKmGZ_XbwYTHBDnoGJROd25OxnIOo9qH_8VtjZsA4NkNlEiO9WminbXD5bTDF_ueJHlJYu_Jec7FBwsIaQu_TvGwXd5vEhBEx6B1Aj3QMaNIYotpnfRBk2XU8mYsSKq91kcC6s Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:00:11.080160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_245af7b7ed61405ba444cddd26fc69fd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}] Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 4f63b1c74b4b4d34b33bef2b6267ecb2 Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:00:11.082112 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'd29fad67-f6ab-422e-9cb7-549c00245204'} Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:00:11.083051 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:00:11.084379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:11.085613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Returning 404 to user: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:00:11.085613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-236c69b3-2ec3-4de5-90c4-5609ae3ccaee tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 404 len: 111 microversion: 2.1 time: 0.033527 Sep 13 20:00:11.085613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 451/893] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:11 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:00:11.204470 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1372630963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241128332", "security_groups": [{"name": "tempest-secgroup-smoke-645998509"}], "block_device_mapping_v2": [{"uuid": "46fd5c26-4e8f-4d06-86b9-7771437ab6c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0c886c7-ba72-4804-b43b-07a5caf41674"}]}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:11.328953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.network.neutron [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] validate_networks() for [('b0c886c7-ba72-4804-b43b-07a5caf41674', None, None, None, None, None)] {{(pid=132127) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:00:11.748434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Flavor limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:00:11.749127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Image limits 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:00:11.749890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Flavor pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:00:11.750337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Image pref 0:0:0 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:00:11.751057 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.virt.hardware [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132127) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:00:11.765573 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.766054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.766478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.767202 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:11.767651 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:11.768066 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:11.786338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:00:11.790713 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for user 4f63b1c74b4b4d34b33bef2b6267ecb2 and project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'ram', 'cores', 'instances'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:00:11.858544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Going to run 1 instances... {{(pid=132127) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:00:11.860820 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46fd5c26-4e8f-4d06-86b9-7771437ab6c4',volume_size=None,volume_type=None)] {{(pid=132127) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:00:12.030992 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9d3eccf2-e3a5-4bd2-bfe4-247a11400983 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.830219 Sep 13 20:00:12.032136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 443/894] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 20:00:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:00:12.049257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6e4002b1-e8e4-46b5-85c3-6dd1814879c7 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:12.050435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6e4002b1-e8e4-46b5-85c3-6dd1814879c7 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:12.188955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6e4002b1-e8e4-46b5-85c3-6dd1814879c7 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:12.197285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6e4002b1-e8e4-46b5-85c3-6dd1814879c7 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1094 microversion: 2.1 time: 0.154880 Sep 13 20:00:12.197928 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 452/895] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:12 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1094 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:13.234779 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:13.235392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:13.242893 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.243392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.244016 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.244751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:13.245314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:13.245735 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:13.329630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:13.341942 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-cf694bd4-b4a5-4aa9-bc6e-e7da5a628137 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1192 microversion: 2.1 time: 0.111773 Sep 13 20:00:13.342862 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 444/896] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:13 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:14.372005 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:14.373084 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:14.385356 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.386311 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.387068 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.388686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:14.389671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:14.390654 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:14.474524 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:14.483417 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ec041fb4-b005-4b3f-816e-30e7d3645b87 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1198 microversion: 2.1 time: 0.119291 Sep 13 20:00:14.484036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 453/897] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:14 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1198 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:15.433379 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-123ce826-5eb7-48cd-b616-8e57f44bb257 req-73bf10a2-96d1-4737-b2f0-8ef108f8fdcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a201a74-9532-4339-8870-162f853a6997", "tag": "f8364066-d849-42c6-8131-ce38b1455a42"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:15.450215 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-123ce826-5eb7-48cd-b616-8e57f44bb257 req-73bf10a2-96d1-4737-b2f0-8ef108f8fdcf service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.451137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-123ce826-5eb7-48cd-b616-8e57f44bb257 req-73bf10a2-96d1-4737-b2f0-8ef108f8fdcf service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.452111 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-123ce826-5eb7-48cd-b616-8e57f44bb257 req-73bf10a2-96d1-4737-b2f0-8ef108f8fdcf service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.474030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-123ce826-5eb7-48cd-b616-8e57f44bb257 req-73bf10a2-96d1-4737-b2f0-8ef108f8fdcf service nova] Creating event network-changed:f8364066-d849-42c6-8131-ce38b1455a42 for instance 4a201a74-9532-4339-8870-162f853a6997 on hv-cinder-82880 Sep 13 20:00:15.485612 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-123ce826-5eb7-48cd-b616-8e57f44bb257 req-73bf10a2-96d1-4737-b2f0-8ef108f8fdcf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055433 Sep 13 20:00:15.487073 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 445/898] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:15.512019 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:15.513224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:15.523390 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.523963 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.524468 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.525413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:15.526026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:15.526586 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:15.677975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:15.691761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e514e21f-f32f-493d-bfbd-fec8569313fb tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.187183 Sep 13 20:00:15.692368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 454/899] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:15 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:16.731665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:16.732423 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:16.748445 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.749009 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.749425 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.750134 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:16.750579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:16.750999 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:16.956585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:16.965218 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a75a809b-28c1-460b-83bd-844288fdee75 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.243089 Sep 13 20:00:16.965809 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 446/900] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:16 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:17.988530 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:17.989356 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:17.996683 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.997200 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.997612 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:17.998331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:17.998773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:17.999187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:18.143017 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:18.151567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-aea74e33-0c20-4b8c-a023-bf44d3435152 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.167135 Sep 13 20:00:18.152173 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 455/901] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:17 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:19.175532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:19.176253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:19.183276 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.183753 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.184196 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.184908 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:19.185384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:19.185801 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:19.325098 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:19.333854 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-34dfc317-b28f-4ad3-8038-eef537c67b9e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.162207 Sep 13 20:00:19.334444 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 447/902] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:19 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:20.360686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:20.361304 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:20.368924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.369465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.369903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.370611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:20.371065 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:20.371491 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:20.460743 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 20:00:20.460945 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Tue Sep 13 20:00:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 (ip 10.222.0.18) !!! Sep 13 20:00:20.515882 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:20.523780 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b6db9df9-f388-4d2a-a5a7-64f27cbfa2c2 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.169321 Sep 13 20:00:20.524354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 456/903] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:20 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:21.548279 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:21.549166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:21.556725 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.557248 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.557681 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.558384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:21.558831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:21.559254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:21.702707 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:21.711641 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5482aa5a-e1e2-4fb6-a3fa-9fd9d4302f8e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.168299 Sep 13 20:00:21.712732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 448/904] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:21 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:22.736046 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:22.736611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:22.738931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:22.744375 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.744877 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.745327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.746009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:22.746455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:22.746871 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:22.886350 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:22.896269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-80deac55-e6bb-4a13-88fb-36ac7a88e8d1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.164045 Sep 13 20:00:22.896865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 457/905] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:22 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:23.921429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:23.922062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:23.924117 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:23.925100 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:23.931916 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.932469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.932828 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:23.933554 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:23.934018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:23.934432 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:24.076109 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:24.084279 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-cf8ba2c6-41f3-44e3-b6e8-ef9c1dcb2d1e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.167211 Sep 13 20:00:24.084854 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 449/906] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:23 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:25.108050 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:25.108759 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:25.116348 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.116834 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.117294 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.117987 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:25.118438 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:25.118855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:25.261958 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:25.269790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-45cba659-fc43-401a-ab60-e32350060452 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.165670 Sep 13 20:00:25.270365 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 458/907] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:25 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:26.107853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-3a4c6808-f658-416b-a113-603e73797e21 req-784f3c9d-d72c-42ae-b7b9-46c7595bf7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a201a74-9532-4339-8870-162f853a6997", "name": "network-vif-plugged", "status": "completed", "tag": "f8364066-d849-42c6-8131-ce38b1455a42"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:26.123683 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-3a4c6808-f658-416b-a113-603e73797e21 req-784f3c9d-d72c-42ae-b7b9-46c7595bf7fc service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.124158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-3a4c6808-f658-416b-a113-603e73797e21 req-784f3c9d-d72c-42ae-b7b9-46c7595bf7fc service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.124789 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-3a4c6808-f658-416b-a113-603e73797e21 req-784f3c9d-d72c-42ae-b7b9-46c7595bf7fc service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.137212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-3a4c6808-f658-416b-a113-603e73797e21 req-784f3c9d-d72c-42ae-b7b9-46c7595bf7fc service nova] Creating event network-vif-plugged:f8364066-d849-42c6-8131-ce38b1455a42 for instance 4a201a74-9532-4339-8870-162f853a6997 on hv-cinder-82880 Sep 13 20:00:26.142668 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-3a4c6808-f658-416b-a113-603e73797e21 req-784f3c9d-d72c-42ae-b7b9-46c7595bf7fc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044172 Sep 13 20:00:26.143274 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 450/908] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:26.296060 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:26.297006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:26.305374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.305978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.306506 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.307365 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:26.308044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:26.308471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:26.450844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:26.459354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3fa9dda5-c999-4afd-9750-82945cff2d57 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.169541 Sep 13 20:00:26.459996 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 459/909] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:26 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:27.267659 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:27.268268 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:27.274750 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.275234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.275660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.276355 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.276794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.277228 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.306712 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-93163e9e-f642-4a10-b62b-1a3b589b8f8a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/ips" status: 200 len: 149 microversion: 2.1 time: 0.045085 Sep 13 20:00:27.307279 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 451/910] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 20:00:27 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/ips => generated 149 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:27.489622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:27.490677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:27.502075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.503150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.503719 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.505044 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:27.505706 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:27.506805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:27.737024 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:27.745184 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1ab1d8c2-6f77-4347-b505-423928c6c772 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1265 microversion: 2.1 time: 0.260563 Sep 13 20:00:27.745766 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 460/911] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:27 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:28.688112 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d31066fa-ecbd-4a44-a16f-b490d33f2e4a"}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:28.690605 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.698232 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.698727 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.699161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.699874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.700327 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.700753 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.768258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:28.769116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.776130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.777636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.778237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.779138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.779699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.780220 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.943800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:28.953663 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-54940c9c-ff8d-4b61-ac29-c0ec84b3496c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1452 microversion: 2.1 time: 0.189414 Sep 13 20:00:28.954252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 461/912] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:28 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:28.976977 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:28.977639 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:28.984247 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.984761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.985208 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:28.985918 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:28.986620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:28.987042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:29.019700 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-52dce8e8-1c77-48dc-ad22-b33c61231374 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335371 Sep 13 20:00:29.021606 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 452/913] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 20:00:28 2022] POST /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:29.299741 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:29.308728 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1f777df7-f201-4543-a50e-15da908131f8 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1452 microversion: 2.1 time: 0.336014 Sep 13 20:00:29.309374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 462/914] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:28 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1452 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:31.211848 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-da7104ab-e458-4111-9e2a-25ef58834585 req-cdb193a6-3025-4f5e-9471-f7688f5d4a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a201a74-9532-4339-8870-162f853a6997", "tag": "f8364066-d849-42c6-8131-ce38b1455a42"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:31.225946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-da7104ab-e458-4111-9e2a-25ef58834585 req-cdb193a6-3025-4f5e-9471-f7688f5d4a66 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:31.226525 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-da7104ab-e458-4111-9e2a-25ef58834585 req-cdb193a6-3025-4f5e-9471-f7688f5d4a66 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:31.226953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-da7104ab-e458-4111-9e2a-25ef58834585 req-cdb193a6-3025-4f5e-9471-f7688f5d4a66 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:31.239161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-da7104ab-e458-4111-9e2a-25ef58834585 req-cdb193a6-3025-4f5e-9471-f7688f5d4a66 service nova] Creating event network-changed:f8364066-d849-42c6-8131-ce38b1455a42 for instance 4a201a74-9532-4339-8870-162f853a6997 on hv-cinder-82880 Sep 13 20:00:31.246646 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-da7104ab-e458-4111-9e2a-25ef58834585 req-cdb193a6-3025-4f5e-9471-f7688f5d4a66 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041264 Sep 13 20:00:31.247254 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 453/915] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:36.757100 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d31066fa-ecbd-4a44-a16f-b490d33f2e4a"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:36.759579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:36.763302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:36.767192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.767690 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.768124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.768841 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:36.769337 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:36.769760 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:36.773263 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:36.879264 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Invalid volume: volume d31066fa-ecbd-4a44-a16f-b490d33f2e4a is already attached to instances: d7a9949c-a495-4069-8090-f8f8119bbc9c Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: POST /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments HTTP/1.1 Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 74 Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:00:36.882580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {"volumeAttachment": {"volumeId": "d31066fa-ecbd-4a44-a16f-b490d33f2e4a"}} Sep 13 20:00:36.884254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Invalid volume: volume d31066fa-ecbd-4a44-a16f-b490d33f2e4a is already attached to instances: d7a9949c-a495-4069-8090-f8f8119bbc9c Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'server_id': 'd7a9949c-a495-4069-8090-f8f8119bbc9c', 'body': {'volumeAttachment': {'volumeId': 'd31066fa-ecbd-4a44-a16f-b490d33f2e4a'}}} Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d31066fa-ecbd-4a44-a16f-b490d33f2e4a is already attached to instances: d7a9949c-a495-4069-8090-f8f8119bbc9c Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:36.885223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d31066fa-ecbd-4a44-a16f-b490d33f2e4a is already attached to instances: d7a9949c-a495-4069-8090-f8f8119bbc9c Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:36.886632 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d31066fa-ecbd-4a44-a16f-b490d33f2e4a is already attached to instances: d7a9949c-a495-4069-8090-f8f8119bbc9c Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 400 to user: Invalid volume: volume d31066fa-ecbd-4a44-a16f-b490d33f2e4a is already attached to instances: d7a9949c-a495-4069-8090-f8f8119bbc9c {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-e958efd6-f837-4b98-9660-2fdd4a724d93 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.131931 Sep 13 20:00:36.888148 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 463/916] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 20:00:36 2022] POST /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments => generated 174 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:00:37.012063 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:37.013103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:37.016477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:37.025764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.026234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.026739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.027510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.027965 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.028359 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.032686 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:37.138096 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lazy-loading 'services' on Instance uuid d7a9949c-a495-4069-8090-f8f8119bbc9c {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:00:37.218141 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f99b2023-66bb-4cc2-b8d2-12a730a20cc0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments/d31066fa-ecbd-4a44-a16f-b490d33f2e4a" status: 202 len: 0 microversion: 2.1 time: 0.215425 Sep 13 20:00:37.218764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 454/917] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 20:00:37 2022] DELETE /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments/d31066fa-ecbd-4a44-a16f-b490d33f2e4a => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:00:37.227899 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:37.230580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:37.237016 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.237502 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.237997 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.238649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:37.239071 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:37.239508 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:37.273899 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-30d14b96-5c6b-4a26-bf22-781ff3cd5ea0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050186 Sep 13 20:00:37.274480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 464/918] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:37 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:38.288115 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.290667 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.297899 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.298376 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.298804 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.299495 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.300015 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.300635 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.340879 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9d2f9183-a605-49ba-bc0a-08e7b4aceec2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057573 Sep 13 20:00:38.341463 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 455/919] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 20:00:38 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 20:00:38.414321 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.414971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.424096 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.424651 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.425240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.426208 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.426775 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.427285 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.459194 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:00:38.542527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3b2c16fa-ce8c-4586-9c47-9eed6094bb1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 204 len: 0 microversion: 2.1 time: 0.131937 Sep 13 20:00:38.543307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 465/920] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:00:38 2022] DELETE /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:00:38.552539 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:38.553193 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:38.559474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.559963 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.560395 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.561140 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:38.561596 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:38.562016 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:38.710849 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:38.720354 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4ade8d82-a51c-42f9-ba49-3d87a4512f5d tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1681 microversion: 2.1 time: 0.171988 Sep 13 20:00:38.721212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 456/921] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:38 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:39.745860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:39.746707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:39.753781 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.754269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.754696 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.755402 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:39.755840 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:39.756275 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:39.906596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:39.915303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9362a52d-b898-44ef-8dd8-9a73339304ee tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1681 microversion: 2.1 time: 0.174345 Sep 13 20:00:39.915896 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 466/922] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:39 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:40.938925 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:40.939796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:40.946626 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.947088 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.947520 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:40.948267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:40.948718 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:40.949166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.046665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:41.059567 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-ae52068d-35aa-4588-a8cb-818996893197 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 200 len: 1614 microversion: 2.1 time: 0.124369 Sep 13 20:00:41.060610 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 457/923] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:40 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 1614 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:00:41.322994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-df9eb229-9498-43d8-8324-88da9d94897a req-055c9a8f-bc29-4401-a649-579de8c0b0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a9949c-a495-4069-8090-f8f8119bbc9c", "name": "network-vif-deleted", "tag": "69633a0a-b2fb-48d9-bb4a-acf43ec54ce6"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:41.334361 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-df9eb229-9498-43d8-8324-88da9d94897a req-055c9a8f-bc29-4401-a649-579de8c0b0bc service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:41.335675 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-df9eb229-9498-43d8-8324-88da9d94897a req-055c9a8f-bc29-4401-a649-579de8c0b0bc service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:41.336743 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-df9eb229-9498-43d8-8324-88da9d94897a req-055c9a8f-bc29-4401-a649-579de8c0b0bc service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:41.356110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-df9eb229-9498-43d8-8324-88da9d94897a req-055c9a8f-bc29-4401-a649-579de8c0b0bc service nova] Creating event network-vif-deleted:69633a0a-b2fb-48d9-bb4a-acf43ec54ce6 for instance d7a9949c-a495-4069-8090-f8f8119bbc9c on hv-cinder-82880 Sep 13 20:00:41.362207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-df9eb229-9498-43d8-8324-88da9d94897a req-055c9a8f-bc29-4401-a649-579de8c0b0bc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Sep 13 20:00:41.362819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 467/924] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:42.096105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:42.097576 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:42.104856 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.105744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.106243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.107026 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:42.107673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:42.108424 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:42.123275 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c HTTP/1.1 Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:00:42.125166 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:00:42.127389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'd7a9949c-a495-4069-8090-f8f8119bbc9c'} Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:00:42.128500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:00:42.130199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:00:42.131399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:00:42.131399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f5e95ba1-4d45-43d9-94b1-e88198f807f5 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 404 len: 111 microversion: 2.1 time: 0.035092 Sep 13 20:00:42.131399 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 458/925] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:42 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:00:42.139818 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6e221b81-3772-4e86-9af1-f7e19460e09f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '.version_select at 0x7f98b698b430>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:42.163805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6e221b81-3772-4e86-9af1-f7e19460e09f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256111561" status: 202 len: 0 microversion: 2.1 time: 0.028909 Sep 13 20:00:42.164838 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 468/926] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 20:00:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1256111561 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:00:42.848689 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-178ab83a-b154-43ce-b0a5-3a5a29eee2c0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: .version_select at 0x7f98b6d7d0d0>, body: {"keypair": {"name": "tempest-keypair-1896123666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwelOSdPjYpL8mZ9YH/5BEIQDNfHVEkkXIilnqa1OPvABe+a4moFlXVn6K1b/7hQKVhm/4wzhsA8Dx8unrRzLyNeLPS58sx3jNp1JQ9Og+LYZ0s15B9NhQ6J/q41lE95w=="}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:42.866018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-178ab83a-b154-43ce-b0a5-3a5a29eee2c0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:00:42.870441 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.quota [None req-178ab83a-b154-43ce-b0a5-3a5a29eee2c0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'key_pairs'} {{(pid=132127) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:00:42.896247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-178ab83a-b154-43ce-b0a5-3a5a29eee2c0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053418 Sep 13 20:00:42.896876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 459/927] 10.222.0.18 () {60 vars in 1159 bytes} [Tue Sep 13 20:00:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:44.279021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-978234894", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8c5fe14-9eff-496c-91ae-1a981d5e6e1b"}], "security_groups": [{"name": "tempest-securitygroup--303085096"}], "key_name": "tempest-keypair-1896123666", "user_data": "}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:44.398929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] validate_networks() for [('a8c5fe14-9eff-496c-91ae-1a981d5e6e1b', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:00:44.867906 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:00:44.868325 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:00:44.868792 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:00:44.869225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:00:44.869652 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:00:44.878776 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.879259 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.879771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.880478 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:44.880931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:44.881410 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:44.900046 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:00:44.904692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Getting quotas for user 02bb08e3dee645e4abe2e6d5e106ea57 and project d7256eb917624a56a2762fcdc3d11b29. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:00:44.916220 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:00:44.918812 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:00:44.973136 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-01539ad6-de9d-4192-ad9f-c8926fdb04b2 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698745 Sep 13 20:00:44.973787 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 469/928] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 20:00:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:00:44.986046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-52706122-5543-479e-975d-682f815502d9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:44.986747 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-52706122-5543-479e-975d-682f815502d9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:45.046901 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-52706122-5543-479e-975d-682f815502d9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:45.054077 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-52706122-5543-479e-975d-682f815502d9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1241 microversion: 2.1 time: 0.072696 Sep 13 20:00:45.054649 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 460/929] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:44 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:46.080828 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:46.081485 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:46.091988 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.092593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.093329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.094171 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:46.094642 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:46.095295 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:46.440990 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:46.449731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8647fd46-61a9-4ff2-85d0-0501b38c4963 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1293 microversion: 2.1 time: 0.375892 Sep 13 20:00:46.450307 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 470/930] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:46 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1293 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:47.473403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:47.473979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:47.481234 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.481697 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.482363 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.483205 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.483669 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.484099 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:47.621038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:47.633512 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-93c1b975-f2c4-42ee-8c4c-1f14fa83699c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1366 microversion: 2.1 time: 0.164229 Sep 13 20:00:47.634169 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 461/931] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:47 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:47.985681 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-6ca2ee5c-7490-4931-81a6-d39e4f417e78 req-b774ae50-d573-446c-90a4-4951e9df6877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932a3281-ad7f-41fa-8618-7e93844f72f4", "tag": "72251bbc-2259-455d-8d13-b41952e80290"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:47.996233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-6ca2ee5c-7490-4931-81a6-d39e4f417e78 req-b774ae50-d573-446c-90a4-4951e9df6877 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:47.996708 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-6ca2ee5c-7490-4931-81a6-d39e4f417e78 req-b774ae50-d573-446c-90a4-4951e9df6877 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:47.997241 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-6ca2ee5c-7490-4931-81a6-d39e4f417e78 req-b774ae50-d573-446c-90a4-4951e9df6877 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.010721 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-6ca2ee5c-7490-4931-81a6-d39e4f417e78 req-b774ae50-d573-446c-90a4-4951e9df6877 service nova] Creating event network-changed:72251bbc-2259-455d-8d13-b41952e80290 for instance 932a3281-ad7f-41fa-8618-7e93844f72f4 on hv-cinder-82880 Sep 13 20:00:48.016281 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-6ca2ee5c-7490-4931-81a6-d39e4f417e78 req-b774ae50-d573-446c-90a4-4951e9df6877 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101665 Sep 13 20:00:48.017465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 471/932] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:00:48.657472 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:48.658190 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:48.665144 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.665633 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.666064 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.666766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:48.667213 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:48.667632 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:48.815532 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:48.824547 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f3b81f9a-99d5-41a0-a9f0-861ab48b45b8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1366 microversion: 2.1 time: 0.171071 Sep 13 20:00:48.825151 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 462/933] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:48 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:49.852187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:49.852771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:49.859628 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.860116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.860551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.861299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:49.861735 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:49.862159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:49.997994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:50.009193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b2b70618-5d20-49fb-be46-bdfa22a016f8 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1366 microversion: 2.1 time: 0.164284 Sep 13 20:00:50.009770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 472/934] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:49 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:51.035530 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:51.035530 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:51.043322 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.043975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.044415 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.045172 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:51.045992 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:51.046416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:51.188926 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:51.197388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d15a1594-36d9-406c-ba21-e0a593eead26 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1366 microversion: 2.1 time: 0.165747 Sep 13 20:00:51.197994 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 463/935] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:51 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:52.220903 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:52.221519 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:52.228066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.228565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.228998 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.229712 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.230145 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.230560 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.248711 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-86973b7c-861b-4b58-b99a-20fb3834e897 req-c2d163a1-e7ca-4f3b-a0f6-c36a623b4298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932a3281-ad7f-41fa-8618-7e93844f72f4", "name": "network-vif-plugged", "status": "completed", "tag": "72251bbc-2259-455d-8d13-b41952e80290"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:52.267093 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-86973b7c-861b-4b58-b99a-20fb3834e897 req-c2d163a1-e7ca-4f3b-a0f6-c36a623b4298 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:52.267836 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-86973b7c-861b-4b58-b99a-20fb3834e897 req-c2d163a1-e7ca-4f3b-a0f6-c36a623b4298 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:52.268461 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-86973b7c-861b-4b58-b99a-20fb3834e897 req-c2d163a1-e7ca-4f3b-a0f6-c36a623b4298 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:52.281796 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-86973b7c-861b-4b58-b99a-20fb3834e897 req-c2d163a1-e7ca-4f3b-a0f6-c36a623b4298 service nova] Creating event network-vif-plugged:72251bbc-2259-455d-8d13-b41952e80290 for instance 932a3281-ad7f-41fa-8618-7e93844f72f4 on hv-cinder-82880 Sep 13 20:00:52.288233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-86973b7c-861b-4b58-b99a-20fb3834e897 req-c2d163a1-e7ca-4f3b-a0f6-c36a623b4298 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043686 Sep 13 20:00:52.289609 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 464/936] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:52.372855 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:52.381160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-23585399-aeb6-4edc-9411-52d28a61659a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1366 microversion: 2.1 time: 0.164465 Sep 13 20:00:52.381756 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 473/937] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:52 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:53.405207 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:53.405937 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:53.413160 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.413759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.414191 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.414891 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:53.415344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:53.415759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:53.562793 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:53.571056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-717bde26-9c24-4184-8144-d342d0083eda tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1366 microversion: 2.1 time: 0.170137 Sep 13 20:00:53.571757 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 465/938] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:53 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:54.594707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:54.595480 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:54.602492 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.602978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.603424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.604131 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.604573 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.605033 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.747613 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:00:54.757925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fb48b484-9879-469a-ab2b-3c1513f93a24 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1555 microversion: 2.1 time: 0.167214 Sep 13 20:00:54.758544 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 474/939] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:00:54 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:00:54.783716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:00:54.783716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:00:54.790344 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.791108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.791264 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.791977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:54.792416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:54.792830 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:54.870932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6f6170bf-2c2d-46a7-81b0-0fd45d1e1f72 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092036 Sep 13 20:00:54.871726 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 466/940] 10.222.0.18 () {58 vars in 1275 bytes} [Tue Sep 13 20:00:54 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:00:55.870626 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-746fbe99-ee93-4cf3-8eff-b5e986ad7efe req-2d4e1f59-a2f6-4ebd-bf8f-aad93c8182f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932a3281-ad7f-41fa-8618-7e93844f72f4", "tag": "72251bbc-2259-455d-8d13-b41952e80290"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:00:55.875813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:55.876501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:55.883790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-746fbe99-ee93-4cf3-8eff-b5e986ad7efe req-2d4e1f59-a2f6-4ebd-bf8f-aad93c8182f3 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:00:55.884303 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-746fbe99-ee93-4cf3-8eff-b5e986ad7efe req-2d4e1f59-a2f6-4ebd-bf8f-aad93c8182f3 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:00:55.884746 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-746fbe99-ee93-4cf3-8eff-b5e986ad7efe req-2d4e1f59-a2f6-4ebd-bf8f-aad93c8182f3 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:00:55.897260 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-746fbe99-ee93-4cf3-8eff-b5e986ad7efe req-2d4e1f59-a2f6-4ebd-bf8f-aad93c8182f3 service nova] Creating event network-changed:72251bbc-2259-455d-8d13-b41952e80290 for instance 932a3281-ad7f-41fa-8618-7e93844f72f4 on hv-cinder-82880 Sep 13 20:00:55.903203 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-746fbe99-ee93-4cf3-8eff-b5e986ad7efe req-2d4e1f59-a2f6-4ebd-bf8f-aad93c8182f3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036403 Sep 13 20:00:55.903815 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 475/941] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:22.561057 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=6 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:22.563249 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:22.564348 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:22.570751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:22.571625 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:22.583460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.584316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.585070 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.586233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.587037 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.587489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.625479 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lazy-loading 'flavor' on Instance uuid 247f7a0a-2a2e-4b40-a96a-f31589cc5810 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:01:22.732748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7d4e7fab-5ec2-411d-84fc-3a027b5ad0a8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "POST /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810/action" status: 202 len: 0 microversion: 2.1 time: 0.172115 Sep 13 20:01:22.733581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 467/942] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 20:01:22 2022] POST /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:01:22.748472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:22.750342 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:22.753964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:22.754747 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:22.762929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.763692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.764140 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.764980 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:22.765449 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:22.765881 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:22.926634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:22.935752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-188f5df2-be33-4225-b7f8-3eb6e7bfbf5d tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.195378 Sep 13 20:01:22.936356 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 476/943] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:22 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:23.961776 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:23.962406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:23.970163 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.970707 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.971139 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:23.971855 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:23.972316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:23.972726 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:24.144175 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:24.153195 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d4cb1b57-669b-45b9-ac84-8572cca6faef tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.196206 Sep 13 20:01:24.153766 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 468/944] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:23 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:25.178221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:25.179062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:25.189826 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.190561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.191188 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.192219 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:25.193007 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:25.193691 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:25.354068 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:25.362706 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c5589f3c-a4b7-4b71-961e-e24acc719c9c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.188447 Sep 13 20:01:25.363321 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 477/945] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:25 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:26.387662 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:26.388403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:26.396240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:26.396742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:26.397220 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:26.397938 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:26.398402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:26.398847 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:26.550395 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:26.559728 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-87f399b4-b8d4-464d-a65b-216fd28e6c74 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.176199 Sep 13 20:01:26.560345 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 469/946] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:26 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:27.584290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:27.585115 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:27.592394 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.592931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.593426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.594157 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:27.594610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:27.595035 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:27.756930 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:27.766242 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b9ce1131-9d0a-4e0e-b36e-e0108d2cb4a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.186002 Sep 13 20:01:27.766819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 478/947] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:27 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:28.807541 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:28.808502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:28.820477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.821355 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.822125 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:28.823317 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:28.824031 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:28.824782 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:29.004756 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:29.013706 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f705f157-4d64-4ab9-8774-445299af0025 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.213131 Sep 13 20:01:29.014475 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 470/948] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:28 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:30.041856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:30.042702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:30.051252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.051854 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.052406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.053245 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:30.053870 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:30.054388 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:30.219171 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:30.228860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-f8317cf8-cd8c-41c4-a5b7-e46bc5fc8221 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.191046 Sep 13 20:01:30.229620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 479/949] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:30 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:31.254454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:31.255182 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:31.263104 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.263734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.264267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.265122 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.265664 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.266292 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.429341 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:31.439224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7b718ea0-9959-405a-91e4-ef35166717b5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.188751 Sep 13 20:01:31.439914 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 471/950] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:31 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:31.721428 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:31.722244 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:31.729362 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.730021 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.730559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.731478 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:31.732033 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:31.732571 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:31.760797 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d878309a-a8ea-453b-9c8b-d6b721ca3d60 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/ips" status: 200 len: 149 microversion: 2.1 time: 0.044121 Sep 13 20:01:31.761516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 480/951] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 20:01:31 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:32.465210 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:32.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:32.473463 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:32.474036 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:32.474566 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:32.475330 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:32.475890 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:32.476360 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:32.639671 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:32.654246 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-b0402eef-2dc5-490c-9982-bbe37f987d26 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.193791 Sep 13 20:01:32.655218 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 472/952] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:32 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:33.193564 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd933cbe-a697-4606-a3b6-570dbd6fe970"}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:33.196095 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:33.204364 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.204922 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.205482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.206247 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.206749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.207210 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.561986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a340f2b1-5310-49ea-9d6f-aefd2c3d5420 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "POST /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372089 Sep 13 20:01:33.562902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 481/953] 10.222.0.18 () {60 vars in 1323 bytes} [Tue Sep 13 20:01:33 2022] POST /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:01:33.692977 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:33.694116 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:33.706526 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.707374 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.708123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.709458 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:33.710296 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:33.711058 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:33.931764 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:33.946217 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-333b8b30-7d15-4613-8510-6601e13e247a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.259260 Sep 13 20:01:33.947290 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 473/954] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:33 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:01:34.974521 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:34.975183 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:34.982293 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.982795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.983207 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:34.983952 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:34.984416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:34.984846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:35.139538 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:35.148165 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-30fd8833-d33f-433b-820e-c9ec4da810c5 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.178782 Sep 13 20:01:35.148943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 482/955] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:34 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:36.172962 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:36.173807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:36.181307 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.181800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.182225 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.182974 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.183433 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.183881 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.337581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:36.346443 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-14c9e7cd-9685-4525-9d8f-77842a2eb066 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1569 microversion: 2.1 time: 0.177972 Sep 13 20:01:36.347140 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 474/956] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:36 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:36.385097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:36.385817 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:36.393271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.393772 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.394237 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.394962 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.395406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.395857 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.446828 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132128) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 20:01:36.525887 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-79b41384-1a9b-49a1-bda9-f63ccda231e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "POST /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810/action" status: 202 len: 0 microversion: 2.1 time: 0.144910 Sep 13 20:01:36.527073 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 483/957] 10.222.0.18 () {60 vars in 1278 bytes} [Tue Sep 13 20:01:36 2022] POST /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:01:36.535428 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:36.536398 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:36.545155 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.545637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.546325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.547181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:36.547994 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:36.548423 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:36.712218 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:36.721505 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bf6b4730-aba3-441b-9dc2-b5c7df52f0a4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1577 microversion: 2.1 time: 0.190026 Sep 13 20:01:36.722547 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 475/958] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:36 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:37.746910 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:37.747730 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:37.755412 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.755923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.756353 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.757105 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:37.757553 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:37.757970 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:37.921798 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:37.932362 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-42181d71-b080-4337-90d8-31474a8f7056 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1519 microversion: 2.1 time: 0.189925 Sep 13 20:01:37.932986 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 484/959] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:37 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:38.586744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-a74cb973-ee3d-4da2-84aa-075cefa780f1 req-ea825690-ec6b-4c05-b690-fb9cbcbf8839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247f7a0a-2a2e-4b40-a96a-f31589cc5810", "name": "network-vif-unplugged", "status": "completed", "tag": "e3d7babf-a6ba-404e-b3eb-a17c07fabe90"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:38.603155 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-a74cb973-ee3d-4da2-84aa-075cefa780f1 req-ea825690-ec6b-4c05-b690-fb9cbcbf8839 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.604030 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-a74cb973-ee3d-4da2-84aa-075cefa780f1 req-ea825690-ec6b-4c05-b690-fb9cbcbf8839 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.604873 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-a74cb973-ee3d-4da2-84aa-075cefa780f1 req-ea825690-ec6b-4c05-b690-fb9cbcbf8839 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.625625 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.compute.server_external_events [req-a74cb973-ee3d-4da2-84aa-075cefa780f1 req-ea825690-ec6b-4c05-b690-fb9cbcbf8839 service nova] Unable to find a host for instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810. Dropping event network-vif-unplugged {{(pid=132127) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 20:01:38.626451 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-a74cb973-ee3d-4da2-84aa-075cefa780f1 req-ea825690-ec6b-4c05-b690-fb9cbcbf8839 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.128268 Sep 13 20:01:38.627194 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 476/960] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 130 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 20:01:38.963188 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:38.963871 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:38.971520 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.972026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.972489 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:38.973250 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:38.973710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:38.974301 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:39.147406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:39.156182 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a1c60cef-370f-4df8-a6aa-a3eb0cd68fae tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1519 microversion: 2.1 time: 0.197077 Sep 13 20:01:39.156770 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 485/961] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:38 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:40.182459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:40.183127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:40.190456 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.190951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.191397 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.192136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:40.192595 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:40.193057 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:40.350643 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:40.359474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4d7ad943-139f-440b-8967-7742ee5b6d32 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1519 microversion: 2.1 time: 0.181150 Sep 13 20:01:40.360080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 477/962] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:40 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:41.400426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:41.401386 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:41.408287 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.408788 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.409272 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.410009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.410470 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.410924 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.440381 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:41.441325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:41.453349 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.454401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.455051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.456286 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.457097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.458103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.606065 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lazy-loading 'services' on Instance uuid 932a3281-ad7f-41fa-8618-7e93844f72f4 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:01:41.653752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:41.665974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-fb0417fd-4cf1-4154-a597-c7d3022c4a33 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1519 microversion: 2.1 time: 0.270263 Sep 13 20:01:41.666862 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 486/963] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:41 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1519 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:41.728301 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-89fbf098-f6a0-4512-9808-389e14c0a6f9 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments/fd933cbe-a697-4606-a3b6-570dbd6fe970" status: 202 len: 0 microversion: 2.1 time: 0.294674 Sep 13 20:01:41.729345 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 478/964] 10.222.0.18 () {58 vars in 1416 bytes} [Tue Sep 13 20:01:41 2022] DELETE /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments/fd933cbe-a697-4606-a3b6-570dbd6fe970 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:01:41.740102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:41.743097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:41.754252 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.755167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.755875 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.756768 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:41.757494 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:41.758243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:41.796753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-287f2049-337e-4ca6-a7d4-7ec56b971a94 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061496 Sep 13 20:01:41.797406 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 487/965] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 20:01:41 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:42.701641 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:42.702552 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:42.709921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.710411 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.710842 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.711592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.712054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.712482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.810345 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:42.813589 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:42.821964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.822462 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.822897 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.823656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:42.825128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:42.825697 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:42.908743 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2cbf7531-0f0f-4678-805e-52e3856a7d1f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098884 Sep 13 20:01:42.912066 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 488/966] 10.222.0.18 () {58 vars in 1302 bytes} [Tue Sep 13 20:01:42 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 20:01:42.941071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:42.957320 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-257d873e-def2-4382-95cd-5344ed0e98b4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.259801 Sep 13 20:01:42.958953 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 479/967] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:42 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:43.011786 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:43.012430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:43.023255 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.024118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.024909 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.026325 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.027154 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.028124 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.079649 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:01:43.134009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:43.221186 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-62bcd58f-27f1-496e-b2af-8c9253367d21 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 204 len: 0 microversion: 2.1 time: 0.216018 Sep 13 20:01:43.228192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 489/968] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:01:43 2022] DELETE /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:01:43.239361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:43.240597 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:43.251519 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.252507 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.253366 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.254741 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:43.255622 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:43.256309 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:43.434621 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:43.443063 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-f7d3ace9-9389-4d3b-9eec-8d7cadd2aea7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1680 microversion: 2.1 time: 0.212117 Sep 13 20:01:43.443647 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 480/969] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:43 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:44.001030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:44.002180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:44.012808 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.013671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.014346 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.015481 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.016182 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.016919 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.184486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:44.193308 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c44bb501-b248-42ad-940f-b1cb9fd605e4 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.199681 Sep 13 20:01:44.193940 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 490/970] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:43 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:44.467629 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:44.468315 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:44.475669 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.476140 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.476603 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.477362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:44.477814 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:44.478240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:44.501046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:44.632231 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:44.641716 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-72dcc3da-4e56-4cae-8ebf-c9a889e85d5a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1680 microversion: 2.1 time: 0.178016 Sep 13 20:01:44.642337 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 481/971] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:44 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:45.217410 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:45.218114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:45.225623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.226122 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.226552 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.227288 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.227743 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.228177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.381795 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.392209 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2feffb29-a601-4ec4-908b-bae28db2891b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.178862 Sep 13 20:01:45.392936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 491/972] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:45 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:45.672157 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:45.673201 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:45.680504 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.681035 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.681477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.682206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:45.682704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:45.683097 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:45.763243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:45.773688 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0b9b4d58-018b-440c-82f6-ccc0f13fd73c tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1613 microversion: 2.1 time: 0.105985 Sep 13 20:01:45.774418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 482/973] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:45 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1613 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:46.420870 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:46.422184 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:46.436248 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.437595 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.438718 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.440162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-4907a62b-7819-4f23-9a05-aa203be396d7 req-782d65d3-6202-44e9-bb0c-aaf6d4e997c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932a3281-ad7f-41fa-8618-7e93844f72f4", "name": "network-vif-deleted", "tag": "72251bbc-2259-455d-8d13-b41952e80290"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:46.440910 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.442146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.443380 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.459636 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4907a62b-7819-4f23-9a05-aa203be396d7 req-782d65d3-6202-44e9-bb0c-aaf6d4e997c1 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.460830 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4907a62b-7819-4f23-9a05-aa203be396d7 req-782d65d3-6202-44e9-bb0c-aaf6d4e997c1 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.461239 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4907a62b-7819-4f23-9a05-aa203be396d7 req-782d65d3-6202-44e9-bb0c-aaf6d4e997c1 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.498181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-4907a62b-7819-4f23-9a05-aa203be396d7 req-782d65d3-6202-44e9-bb0c-aaf6d4e997c1 service nova] Creating event network-vif-deleted:72251bbc-2259-455d-8d13-b41952e80290 for instance 932a3281-ad7f-41fa-8618-7e93844f72f4 on hv-cinder-82880 Sep 13 20:01:46.508459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-4907a62b-7819-4f23-9a05-aa203be396d7 req-782d65d3-6202-44e9-bb0c-aaf6d4e997c1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075024 Sep 13 20:01:46.514200 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 483/974] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:01:46.717610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.735992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6b66cb5d-91ce-4c6f-8eb9-8b35c5d9a364 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.322254 Sep 13 20:01:46.753189 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 492/975] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:46 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:46.801754 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:46.806371 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:46.814044 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.814653 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.815184 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.816017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.816552 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.817095 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.853449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:46.853943 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:46.854387 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:46.854845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lazy-loading 'fault' on Instance uuid 932a3281-ad7f-41fa-8618-7e93844f72f4 {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:01:46.899723 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bb08e3dee645e4abe2e6d5e106ea57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7256eb917624a56a2762fcdc3d11b29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:46.909469 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-90b52c62-8e20-4846-9cb8-cf2b0e137c7a tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 200 len: 1331 microversion: 2.1 time: 0.113501 Sep 13 20:01:46.910240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 484/976] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:46 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:47.772563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:47.773593 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:47.783537 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.784633 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.785289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.786376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.787030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.787884 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.938127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:47.940311 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:47.952758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.954079 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.954874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.956493 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:47.957746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:47.958516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:47.978454 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:47.985974 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:47.987466 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-64fe72a7-4162-462d-aa42-39ff95ec806b tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.227643 Sep 13 20:01:47.989127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 493/977] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:47 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 HTTP/1.1 Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:01:47.989658 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:47.991617 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '932a3281-ad7f-41fa-8618-7e93844f72f4'} Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:47.992486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:47.994288 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:47.995778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:47.995778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c95bf23e-b67f-45b9-9483-cfecbd313c78 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 404 len: 111 microversion: 2.1 time: 0.061085 Sep 13 20:01:47.995778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 485/978] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:47 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 20:01:48.010383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-64c8a683-6feb-43c1-a4a6-3d3dd5594c8e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '.version_select at 0x7f98b7f4d280>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:48.046699 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-64c8a683-6feb-43c1-a4a6-3d3dd5594c8e tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896123666" status: 202 len: 0 microversion: 2.1 time: 0.044481 Sep 13 20:01:48.048187 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 494/979] 10.222.0.18 () {58 vars in 1221 bytes} [Tue Sep 13 20:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1896123666 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 20:01:49.045851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:49.047025 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:49.059603 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.060413 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.061231 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.062468 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:49.063300 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:49.064018 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:49.269900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:49.284240 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dbf354cb-4cd7-44fc-8448-bc2b3e6d493a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.252499 Sep 13 20:01:49.285383 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 486/980] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:49 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:50.146939 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:50.147714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:50.159884 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.160806 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.161669 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.163046 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.163925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.164725 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.189761 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 HTTP/1.1 Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:50.192701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.195192 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '932a3281-ad7f-41fa-8618-7e93844f72f4'} Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:50.196655 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.199451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.202163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:50.202163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1e3a0f37-f156-4443-9574-3dbb5e8b698b tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 404 len: 111 microversion: 2.1 time: 0.055888 Sep 13 20:01:50.202163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 495/981] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:01:50 2022] DELETE /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:50.212435 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:50.213885 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 932a3281-ad7f-41fa-8618-7e93844f72f4] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:50.226456 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.227291 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.228080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.229434 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.230220 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.230979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.257599 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 HTTP/1.1 Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:01:50.260837 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.263446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '932a3281-ad7f-41fa-8618-7e93844f72f4'} Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:50.265127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. Sep 13 20:01:50.268017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:50.270510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance 932a3281-ad7f-41fa-8618-7e93844f72f4 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:50.270510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-9743f18b-b4a2-4866-b02b-5f85025b8d70 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4" status: 404 len: 111 microversion: 2.1 time: 0.057658 Sep 13 20:01:50.270510 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 487/982] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:50 2022] GET /compute/v2.1/servers/932a3281-ad7f-41fa-8618-7e93844f72f4 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:50.319665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:50.320623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:50.330331 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.331023 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.331634 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.332701 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:50.333426 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:50.334026 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:50.531927 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:50.546407 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-bb502577-ab61-4312-b249-20f7f8571648 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.233771 Sep 13 20:01:50.547646 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 496/983] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:50 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:51.490652 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.491266 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.499133 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.499851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.500357 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.501709 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.502511 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.503360 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.521935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: DELETE /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c HTTP/1.1 Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:01:51.523578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.526389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'd7a9949c-a495-4069-8090-f8f8119bbc9c'} Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:51.528000 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.530795 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.533544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:51.533544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e3ca7cc6-6ae4-4a10-a373-0a471a451345 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 404 len: 111 microversion: 2.1 time: 0.038748 Sep 13 20:01:51.533544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 488/984] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:01:51 2022] DELETE /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 20:01:51.536394 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.537261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: d7a9949c-a495-4069-8090-f8f8119bbc9c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.546898 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.547569 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.548550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.549542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.550146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.550709 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.571915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c HTTP/1.1 Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:51.575603 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.577395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'd7a9949c-a495-4069-8090-f8f8119bbc9c'} Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:51.578270 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. Sep 13 20:01:51.579545 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.580754 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.580847 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance d7a9949c-a495-4069-8090-f8f8119bbc9c could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:51.581006 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.581089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-167c574a-83f8-4ffe-8661-8b9a66167e80 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c" status: 404 len: 111 microversion: 2.1 time: 0.047176 Sep 13 20:01:51.581089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 497/985] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:51 2022] GET /compute/v2.1/servers/d7a9949c-a495-4069-8090-f8f8119bbc9c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 20:01:51.589866 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.590579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.591049 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.591582 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.592389 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.593748 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.594589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.595392 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.598163 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.598652 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.599089 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.599804 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.600260 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.600710 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.616622 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e HTTP/1.1 Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:51.618254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.626290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '07f51bbf-5129-4092-b714-cf07c9d46e7e'} Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:51.630904 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.639822 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.642648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:51.642648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-32eed60f-98a7-4818-aefb-19f78c25d471 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 404 len: 111 microversion: 2.1 time: 0.035846 Sep 13 20:01:51.642648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 498/986] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:01:51 2022] DELETE /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 20:01:51.642648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:51.642648 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: 07f51bbf-5129-4092-b714-cf07c9d46e7e] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:51.644752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.644752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.644752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.644752 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:51.645456 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:51.645456 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:51.659681 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e HTTP/1.1 Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:51.661961 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.665125 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '07f51bbf-5129-4092-b714-cf07c9d46e7e'} Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:51.666925 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. Sep 13 20:01:51.671605 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:51.674075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance 07f51bbf-5129-4092-b714-cf07c9d46e7e could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:51.674075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5dce0b75-2dc8-4963-b190-62240c1abe4f tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e" status: 404 len: 111 microversion: 2.1 time: 0.037516 Sep 13 20:01:51.674075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 499/987] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:51 2022] GET /compute/v2.1/servers/07f51bbf-5129-4092-b714-cf07c9d46e7e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:51.840241 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:51.852489 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d26f30a9-ac84-46f1-986d-963ea02945f7 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.283229 Sep 13 20:01:51.853508 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 489/988] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:51 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:52.890253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:52.891133 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:52.892363 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:52.893384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:52.893598 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:52.897108 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=49 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:52.900230 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.901389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.902102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.903243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.903984 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.904702 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.906986 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.907785 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.908494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.909642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.910396 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.911158 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.932629 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 HTTP/1.1 Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:52.934266 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.936167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'f105c686-df5a-49ca-80cf-2ab5e2e2b6e6'} Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:52.937464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.941844 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.943972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:52.943972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-b07327dd-8503-48df-8d13-c9895c34edb7 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 404 len: 111 microversion: 2.1 time: 0.050364 Sep 13 20:01:52.943972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 500/989] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:01:52 2022] DELETE /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:52.950905 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:52.951679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] [instance: f105c686-df5a-49ca-80cf-2ab5e2e2b6e6] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:52.958716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.959202 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.959686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.960396 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:52.960839 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:52.961298 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:52.977345 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] HTTP exception thrown: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Request method failure captured: Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 HTTP/1.1 Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCnhJX6nMJJaACtDtxHAiMudyTXEdbCVszNKRiBWZn-2PfiU9SVvYdaCq26EwkOzwyrDleO62ztYc16wuH8TAavUOhwQxmwq_1M-y4YIQZTbaQMImXFzIM1a9y_MFgRLePHQa7OmE3YvaQxXkoxcIAidnPb2cpZGOmCy_GV3f5w8gI Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:52.978852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d7256eb917624a56a2762fcdc3d11b29", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d7256eb917624a56a2762fcdc3d11b29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d7256eb917624a56a2762fcdc3d11b29"}]}] Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: d7256eb917624a56a2762fcdc3d11b29 Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2053147758 Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 02bb08e3dee645e4abe2e6d5e106ea57 Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-AttachVolumeNegativeTest-2053147758-project Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.981731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'f105c686-df5a-49ca-80cf-2ab5e2e2b6e6'} Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:52.983258 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. Sep 13 20:01:52.986009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:52.988395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] Returning 404 to user: Instance f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:52.988395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1419ff75-769c-429e-a3eb-f2c6298549b0 tempest-AttachVolumeNegativeTest-2053147758 tempest-AttachVolumeNegativeTest-2053147758-project] 10.222.0.18 "GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6" status: 404 len: 111 microversion: 2.1 time: 0.036942 Sep 13 20:01:52.988395 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 501/990] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:52 2022] GET /compute/v2.1/servers/f105c686-df5a-49ca-80cf-2ab5e2e2b6e6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:53.116554 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:53.132373 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-782f4775-482d-4fc3-8b30-90f4e7c36f67 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.244159 Sep 13 20:01:53.133501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 490/991] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:52 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:54.169487 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:54.170490 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:54.184087 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.185111 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.185993 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.187314 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.188172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.188964 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.420868 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:54.435852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6c1191a3-b846-442a-88b3-204f41fe7110 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.270232 Sep 13 20:01:54.435852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 502/992] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:54 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:54.683710 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-5aa6e3e8-4deb-4d14-94a8-cc85c2cf783a req-e91f355b-c115-4a7d-b1d1-a5fa6e30c31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247f7a0a-2a2e-4b40-a96a-f31589cc5810", "name": "network-vif-plugged", "status": "completed", "tag": "e3d7babf-a6ba-404e-b3eb-a17c07fabe90"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:54.700952 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-5aa6e3e8-4deb-4d14-94a8-cc85c2cf783a req-e91f355b-c115-4a7d-b1d1-a5fa6e30c31a service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:54.701712 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-5aa6e3e8-4deb-4d14-94a8-cc85c2cf783a req-e91f355b-c115-4a7d-b1d1-a5fa6e30c31a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:54.702428 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-5aa6e3e8-4deb-4d14-94a8-cc85c2cf783a req-e91f355b-c115-4a7d-b1d1-a5fa6e30c31a service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:54.720835 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-5aa6e3e8-4deb-4d14-94a8-cc85c2cf783a req-e91f355b-c115-4a7d-b1d1-a5fa6e30c31a service nova] Creating event network-vif-plugged:e3d7babf-a6ba-404e-b3eb-a17c07fabe90 for instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 on hv-cinder-82880 Sep 13 20:01:54.729810 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-5aa6e3e8-4deb-4d14-94a8-cc85c2cf783a req-e91f355b-c115-4a7d-b1d1-a5fa6e30c31a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050119 Sep 13 20:01:54.731740 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 491/993] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:01:55.462568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:55.463563 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:55.472589 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.473957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.474828 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.475954 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:55.476856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:55.477792 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:55.705985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:55.719166 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8f19d937-6559-4e2f-9d8e-de2e89a4409c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1575 microversion: 2.1 time: 0.261271 Sep 13 20:01:55.719936 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 503/994] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:55 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1575 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:56.754908 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:56.757454 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:01:56.770269 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.771440 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.772420 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:56.780839 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:01:56.781855 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:01:56.782684 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:01:57.080253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:01:57.095858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c2147115-069a-481a-b558-30f666be7ba8 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1562 microversion: 2.1 time: 0.354345 Sep 13 20:01:57.096981 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 492/995] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:01:56 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1562 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:01:58.874368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-195c0da9-8cda-4620-8951-dad698a58b7d tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Action: 'create', calling method: .version_select at 0x7f98b698bb80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1492715141", "metadata": {"Type": "work"}}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-195c0da9-8cda-4620-8951-dad698a58b7d tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Request method failure captured: Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 122 Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOG2-n6CGcxYAgE5VXGYN_HYK2SP2QzAiJwF6VgB_7PYGEC7QzhBPMs7irmRZOUeUub2ojJf_n1jqjZ1v7Jwk1vozIlxIMifF8xtU8_MXgniCoCXHLbrQ95fpNIAoZuiIDOJD0z8lJkXb11dbMiJ5QM8lX59OhaOkCaHhUQt-_XES_w Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:58.902779 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89381cd3cca84de38966ba898d8bf920", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}] Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: a8abaeb99550447583aafb24276a2285 Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1492715141", "metadata": {"Type": "work"}}} Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: Sep 13 20:01:58.904464 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1492715141', 'metadata': {'Type': 'work'}}}} Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise error Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:58.905484 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 20:01:58.907299 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 20:01:58.908581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 20:01:58.908581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.908581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-195c0da9-8cda-4620-8951-dad698a58b7d tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:58.908581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-195c0da9-8cda-4620-8951-dad698a58b7d tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.166188 Sep 13 20:01:58.908581 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 504/996] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 20:01:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:01:58.918418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-86b08d5c-428f-4a30-9ebc-23d97ce5c8b2 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Action: 'create', calling method: .version_select at 0x7f98b6b570d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-280152550", "metadata": {"Type": "work"}}} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-86b08d5c-428f-4a30-9ebc-23d97ce5c8b2 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Request method failure captured: Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 119 Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOG2-n6CGcxYAgE5VXGYN_HYK2SP2QzAiJwF6VgB_7PYGEC7QzhBPMs7irmRZOUeUub2ojJf_n1jqjZ1v7Jwk1vozIlxIMifF8xtU8_MXgniCoCXHLbrQ95fpNIAoZuiIDOJD0z8lJkXb11dbMiJ5QM8lX59OhaOkCaHhUQt-_XES_w Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:01:58.923975 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89381cd3cca84de38966ba898d8bf920", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}] Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: a8abaeb99550447583aafb24276a2285 Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-280152550", "metadata": {"Type": "work"}}} Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: Sep 13 20:01:58.926549 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-280152550', 'metadata': {'Type': 'work'}}}} Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise error Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi '0' Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:58.927935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 20:01:58.930631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 20:01:58.932956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 20:01:58.932956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.932956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-86b08d5c-428f-4a30-9ebc-23d97ce5c8b2 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:58.932956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-86b08d5c-428f-4a30-9ebc-23d97ce5c8b2 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011360 Sep 13 20:01:58.932956 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 493/997] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 20:01:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:01:58.935978 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-aab8a20f-4fe0-4f3c-8540-86d024802a03 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Action: 'create', calling method: .version_select at 0x7f98b698ef70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1352430262", "metadata": {"Type": "work"}}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-aab8a20f-4fe0-4f3c-8540-86d024802a03 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Request method failure captured: Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 119 Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOG2-n6CGcxYAgE5VXGYN_HYK2SP2QzAiJwF6VgB_7PYGEC7QzhBPMs7irmRZOUeUub2ojJf_n1jqjZ1v7Jwk1vozIlxIMifF8xtU8_MXgniCoCXHLbrQ95fpNIAoZuiIDOJD0z8lJkXb11dbMiJ5QM8lX59OhaOkCaHhUQt-_XES_w Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:58.942736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89381cd3cca84de38966ba898d8bf920", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}] Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: a8abaeb99550447583aafb24276a2285 Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1352430262", "metadata": {"Type": "work"}}} Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: Sep 13 20:01:58.945273 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1352430262', 'metadata': {'Type': 'work'}}}} Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise error Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi '' Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:58.946992 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 20:01:58.949900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 20:01:58.952527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 20:01:58.952527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.952527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-aab8a20f-4fe0-4f3c-8540-86d024802a03 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:58.952527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-aab8a20f-4fe0-4f3c-8540-86d024802a03 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012633 Sep 13 20:01:58.952527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 505/998] 10.222.0.18 () {60 vars in 1156 bytes} [Tue Sep 13 20:01:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 20:01:58.958219 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-20eed65b-a450-4e94-a177-3b273f99a9a9 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Calling method '.version_select at 0x7f98b6b42940>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:58.989907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-20eed65b-a450-4e94-a177-3b273f99a9a9 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] HTTP exception thrown: Volume tempest-invalid-1564053891 could not be found. Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-20eed65b-a450-4e94-a177-3b273f99a9a9 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Request method failure captured: Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1564053891 HTTP/1.1 Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOG2-n6CGcxYAgE5VXGYN_HYK2SP2QzAiJwF6VgB_7PYGEC7QzhBPMs7irmRZOUeUub2ojJf_n1jqjZ1v7Jwk1vozIlxIMifF8xtU8_MXgniCoCXHLbrQ95fpNIAoZuiIDOJD0z8lJkXb11dbMiJ5QM8lX59OhaOkCaHhUQt-_XES_w Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:01:58.991874 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89381cd3cca84de38966ba898d8bf920", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}] Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: a8abaeb99550447583aafb24276a2285 Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Volume tempest-invalid-1564053891 could not be found. Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'tempest-invalid-1564053891'} Sep 13 20:01:58.998474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1564053891 could not be found. (HTTP 404) (Request-ID: req-b20c1601-2b42-4391-ad5b-9135cbca405e) Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:58.999500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:01:59.001028 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1564053891 could not be found. Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:59.002431 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1564053891 could not be found. Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1564053891 could not be found. Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-20eed65b-a450-4e94-a177-3b273f99a9a9 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Returning 404 to user: Volume tempest-invalid-1564053891 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-20eed65b-a450-4e94-a177-3b273f99a9a9 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1564053891" status: 404 len: 99 microversion: 2.1 time: 0.039709 Sep 13 20:01:59.003920 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 494/999] 10.222.0.18 () {58 vars in 1218 bytes} [Tue Sep 13 20:01:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1564053891 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 20:01:59.004955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0801b57b-3906-4d8b-8f9c-4b0088bbad97 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004557 Sep 13 20:01:59.004955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 506/1000] 10.222.0.18 () {58 vars in 1140 bytes} [Tue Sep 13 20:01:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 20:01:59.016303 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-43980636-a0fa-4c17-9fae-42725ef2444b tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004132 Sep 13 20:01:59.016790 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 495/1001] 10.222.0.18 () {58 vars in 1137 bytes} [Tue Sep 13 20:01:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 20:01:59.027883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-35ff80a8-dd57-4d67-8400-a4f0cab8b48f tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Calling method '.version_select at 0x7f98b698b940>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:59.058846 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-35ff80a8-dd57-4d67-8400-a4f0cab8b48f tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] HTTP exception thrown: Volume f682906b-ea84-4a5e-a746-06a5ad82d2db could not be found. Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-35ff80a8-dd57-4d67-8400-a4f0cab8b48f tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Request method failure captured: Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/os-volumes/f682906b-ea84-4a5e-a746-06a5ad82d2db HTTP/1.1 Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOG2-n6CGcxYAgE5VXGYN_HYK2SP2QzAiJwF6VgB_7PYGEC7QzhBPMs7irmRZOUeUub2ojJf_n1jqjZ1v7Jwk1vozIlxIMifF8xtU8_MXgniCoCXHLbrQ95fpNIAoZuiIDOJD0z8lJkXb11dbMiJ5QM8lX59OhaOkCaHhUQt-_XES_w Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:01:59.061042 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89381cd3cca84de38966ba898d8bf920", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}] Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: a8abaeb99550447583aafb24276a2285 Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Volume f682906b-ea84-4a5e-a746-06a5ad82d2db could not be found. Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'f682906b-ea84-4a5e-a746-06a5ad82d2db'} Sep 13 20:01:59.064411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f682906b-ea84-4a5e-a746-06a5ad82d2db could not be found. (HTTP 404) (Request-ID: req-445ea221-2cad-4ec0-bdc6-6286b1ea082a) Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.066141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 20:01:59.068472 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f682906b-ea84-4a5e-a746-06a5ad82d2db could not be found. Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 20:01:59.070717 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f682906b-ea84-4a5e-a746-06a5ad82d2db could not be found. Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f682906b-ea84-4a5e-a746-06a5ad82d2db could not be found. Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-35ff80a8-dd57-4d67-8400-a4f0cab8b48f tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Returning 404 to user: Volume f682906b-ea84-4a5e-a746-06a5ad82d2db could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-35ff80a8-dd57-4d67-8400-a4f0cab8b48f tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/f682906b-ea84-4a5e-a746-06a5ad82d2db" status: 404 len: 109 microversion: 2.1 time: 0.041685 Sep 13 20:01:59.072803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 507/1002] 10.222.0.18 () {58 vars in 1248 bytes} [Tue Sep 13 20:01:59 2022] DELETE /compute/v2.1/os-volumes/f682906b-ea84-4a5e-a746-06a5ad82d2db => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:01:59.075118 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d50a94d0-5788-4256-8775-b22cb2bfdf18 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Calling method '.version_select at 0x7f98b69fe820>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:01:59.107487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-d50a94d0-5788-4256-8775-b22cb2bfdf18 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] HTTP exception thrown: Volume 8a7c40eb-0933-4483-a96b-b4d0d6841ac2 could not be found. Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d50a94d0-5788-4256-8775-b22cb2bfdf18 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Request method failure captured: Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/os-volumes/8a7c40eb-0933-4483-a96b-b4d0d6841ac2 HTTP/1.1 Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOG2-n6CGcxYAgE5VXGYN_HYK2SP2QzAiJwF6VgB_7PYGEC7QzhBPMs7irmRZOUeUub2ojJf_n1jqjZ1v7Jwk1vozIlxIMifF8xtU8_MXgniCoCXHLbrQ95fpNIAoZuiIDOJD0z8lJkXb11dbMiJ5QM8lX59OhaOkCaHhUQt-_XES_w Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:01:59.109506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_89381cd3cca84de38966ba898d8bf920", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/89381cd3cca84de38966ba898d8bf920"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/89381cd3cca84de38966ba898d8bf920"}]}] Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 89381cd3cca84de38966ba898d8bf920 Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-VolumesNegativeTest-664141671 Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: a8abaeb99550447583aafb24276a2285 Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-VolumesNegativeTest-664141671-project Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Volume 8a7c40eb-0933-4483-a96b-b4d0d6841ac2 could not be found. Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '8a7c40eb-0933-4483-a96b-b4d0d6841ac2'} Sep 13 20:01:59.111900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a7c40eb-0933-4483-a96b-b4d0d6841ac2 could not be found. (HTTP 404) (Request-ID: req-74bb8cd2-9869-4ef6-b852-1e4f9284cdea) Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.113421 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 20:01:59.115528 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a7c40eb-0933-4483-a96b-b4d0d6841ac2 could not be found. Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 20:01:59.117477 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a7c40eb-0933-4483-a96b-b4d0d6841ac2 could not be found. Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a7c40eb-0933-4483-a96b-b4d0d6841ac2 could not be found. Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-d50a94d0-5788-4256-8775-b22cb2bfdf18 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] Returning 404 to user: Volume 8a7c40eb-0933-4483-a96b-b4d0d6841ac2 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-d50a94d0-5788-4256-8775-b22cb2bfdf18 tempest-VolumesNegativeTest-664141671 tempest-VolumesNegativeTest-664141671-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8a7c40eb-0933-4483-a96b-b4d0d6841ac2" status: 404 len: 109 microversion: 2.1 time: 0.040148 Sep 13 20:01:59.119294 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 496/1003] 10.222.0.18 () {58 vars in 1245 bytes} [Tue Sep 13 20:01:59 2022] GET /compute/v2.1/os-volumes/8a7c40eb-0933-4483-a96b-b4d0d6841ac2 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:02:08.158003 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=7 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:08.159036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:08.165641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1325275586", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-241128332", "security_groups": [{"name": "tempest-secgroup-smoke-645998509"}], "block_device_mapping_v2": [{"uuid": "ae136806-926e-4197-9f6e-b8537c4c8ab8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0c886c7-ba72-4804-b43b-07a5caf41674"}]}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:08.344976 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] validate_networks() for [('b0c886c7-ba72-4804-b43b-07a5caf41674', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:02:08.879076 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:02:08.879824 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:02:08.880662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:02:08.881552 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:02:08.882301 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:02:08.898236 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.898842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.899445 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.900267 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:08.900805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:08.901351 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:08.926378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:02:08.932482 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Getting quotas for user 4f63b1c74b4b4d34b33bef2b6267ecb2 and project 245af7b7ed61405ba444cddd26fc69fd. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:02:09.001643 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:02:09.003902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae136806-926e-4197-9f6e-b8537c4c8ab8',volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:02:09.192959 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-01f59fa4-41c0-4529-a77d-2fd577d90408 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.036643 Sep 13 20:02:09.193983 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 508/1004] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 20:02:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 20:02:09.206986 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-94fb4bd0-bd73-4885-a0e1-3d3ea47a1674 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:09.208267 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-94fb4bd0-bd73-4885-a0e1-3d3ea47a1674 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:09.211253 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=5 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:09.211980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=50 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:09.292866 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-94fb4bd0-bd73-4885-a0e1-3d3ea47a1674 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:09.307055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-94fb4bd0-bd73-4885-a0e1-3d3ea47a1674 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1094 microversion: 2.1 time: 0.104431 Sep 13 20:02:09.308135 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 497/1005] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:09 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:10.348114 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:10.348772 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:10.357000 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.357636 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.358248 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.359269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:10.360156 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:10.360748 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:10.434009 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:10.444110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d9b30f55-9996-458c-8119-366df441dd7a tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1192 microversion: 2.1 time: 0.101359 Sep 13 20:02:10.444860 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 509/1006] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:10 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:11.470552 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:11.471332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:11.479014 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.480013 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.480858 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.482080 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:11.482823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:11.483530 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:11.535567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-937937547", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "networks": [{"uuid": "9ce68d72-004b-4c7c-839a-ab788b874cb8"}]}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:11.615184 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] validate_networks() for [('9ce68d72-004b-4c7c-839a-ab788b874cb8', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:02:11.736768 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:11.750591 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-19339700-7d1a-481c-8282-5c7ca5a4ba96 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1277 microversion: 2.1 time: 0.283729 Sep 13 20:02:11.752087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 498/1007] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:11 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:12.297619 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:02:12.298540 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:02:12.299815 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:02:12.300620 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:02:12.301665 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:02:12.317894 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.318762 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.319503 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.320869 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.321677 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.322446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.354476 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Getting quotas for project 241fa7029c7d46518c2e36983545cd5c. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:02:12.362055 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Getting quotas for user e240680bbf2c4f02a1429b335261de3d and project 241fa7029c7d46518c2e36983545cd5c. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:02:12.382943 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:02:12.387116 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:02:12.476498 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ffca0a2a-c359-4213-930c-be5e75daf494 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944980 Sep 13 20:02:12.478384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 510/1008] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 20:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 20:02:12.501892 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-dea7c310-4ce2-45ea-a0f2-a0a392978771 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:12.503252 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-dea7c310-4ce2-45ea-a0f2-a0a392978771 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:12.604488 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-dea7c310-4ce2-45ea-a0f2-a0a392978771 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:12.617999 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-dea7c310-4ce2-45ea-a0f2-a0a392978771 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1213 microversion: 2.1 time: 0.131017 Sep 13 20:02:12.619224 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 499/1009] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:12 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1213 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:12.657223 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-609accdf-8a9e-4f83-abbd-9e0312b4943f req-1e81cfb6-eb44-4832-a11b-cfd1be619762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1be983b-ba0f-41d1-9ff9-1bae4b7656d0", "tag": "682bfae0-aedd-4a6b-b9af-68215492aa65"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:12.675607 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-609accdf-8a9e-4f83-abbd-9e0312b4943f req-1e81cfb6-eb44-4832-a11b-cfd1be619762 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.676177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-609accdf-8a9e-4f83-abbd-9e0312b4943f req-1e81cfb6-eb44-4832-a11b-cfd1be619762 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.676847 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-609accdf-8a9e-4f83-abbd-9e0312b4943f req-1e81cfb6-eb44-4832-a11b-cfd1be619762 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.694809 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-609accdf-8a9e-4f83-abbd-9e0312b4943f req-1e81cfb6-eb44-4832-a11b-cfd1be619762 service nova] Creating event network-changed:682bfae0-aedd-4a6b-b9af-68215492aa65 for instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 on hv-cinder-82880 Sep 13 20:02:12.701559 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-609accdf-8a9e-4f83-abbd-9e0312b4943f req-1e81cfb6-eb44-4832-a11b-cfd1be619762 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070307 Sep 13 20:02:12.707256 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 511/1010] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:12.792666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:12.793449 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:12.804229 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.805140 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.806046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:12.807252 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:12.808245 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:12.809087 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.017951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:13.034468 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-0ec7f0d1-247e-4757-bfe2-07af851b67b1 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.248590 Sep 13 20:02:13.035990 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 500/1011] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:12 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:13.661567 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:13.662586 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:13.669893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.670383 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.670819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.671551 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:13.672005 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:13.672430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:13.768130 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:13.780579 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0651415a-4c56-4b6d-b0e7-3609deaf9e2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1265 microversion: 2.1 time: 0.123780 Sep 13 20:02:13.795177 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 512/1012] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:13 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:14.079484 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:14.080666 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:14.092285 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.093137 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.093823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.095165 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.095951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.096650 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.288684 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.308032 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-fa148bec-1f21-4370-a9e4-6e59f617ebfd tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.235198 Sep 13 20:02:14.310029 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 501/1013] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:14 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:14.808451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:14.809385 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:14.818260 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.819080 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.819657 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.820857 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:14.821477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:14.822014 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:14.935082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:14.944514 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-06834f2e-25d0-4b86-9b09-f7eaf511db00 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1271 microversion: 2.1 time: 0.142276 Sep 13 20:02:14.945162 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 513/1014] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:14 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:15.336372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.337647 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.349414 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.350313 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.351090 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.352448 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.353338 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.354130 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.692202 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:15.702071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-670b692e-36f2-427e-8d89-a3190144566c tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.373225 Sep 13 20:02:15.702845 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 502/1015] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:15.972465 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:15.973340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:15.980819 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.981358 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.981773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:15.982528 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:15.982974 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:15.983384 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.328841 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:16.337606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-67022047-de1a-4d39-90a6-c4e1e453b0df tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1313 microversion: 2.1 time: 0.370871 Sep 13 20:02:16.338224 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 514/1016] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:15 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:16.696388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-4a58c581-d99c-47a2-849f-e095266029fe req-9b038a20-535a-4290-8cca-80728d37bbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57cea0d8-0e17-47c8-b231-5c352f17d991", "tag": "1d4810e4-2f3c-4f43-9639-c4dac1d6bf4b"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:16.713905 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4a58c581-d99c-47a2-849f-e095266029fe req-9b038a20-535a-4290-8cca-80728d37bbce service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.714758 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4a58c581-d99c-47a2-849f-e095266029fe req-9b038a20-535a-4290-8cca-80728d37bbce service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.715529 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-4a58c581-d99c-47a2-849f-e095266029fe req-9b038a20-535a-4290-8cca-80728d37bbce service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.731138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:16.732167 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:16.738536 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-4a58c581-d99c-47a2-849f-e095266029fe req-9b038a20-535a-4290-8cca-80728d37bbce service nova] Creating event network-changed:1d4810e4-2f3c-4f43-9639-c4dac1d6bf4b for instance 57cea0d8-0e17-47c8-b231-5c352f17d991 on hv-cinder-82880 Sep 13 20:02:16.742340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.743039 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.743611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.745737 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:16.746527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:16.747179 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:16.747917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-4a58c581-d99c-47a2-849f-e095266029fe req-9b038a20-535a-4290-8cca-80728d37bbce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216223 Sep 13 20:02:16.749480 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 503/1017] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:02:17.019071 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:17.030517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8d734057-0e74-4989-a859-6c649d2d2db0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.307545 Sep 13 20:02:17.040601 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 515/1018] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:16 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:17.361015 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:17.361739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:17.368857 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.369476 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.370001 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.370805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:17.371417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:17.372013 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:17.542486 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:17.551775 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-71833ca9-ef38-4843-9a95-7bb4f1f20636 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1313 microversion: 2.1 time: 0.195151 Sep 13 20:02:17.552450 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 504/1019] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:17 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:18.059722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:18.060727 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:18.068915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.069442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.069879 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.070610 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.071067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.071486 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.500302 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:18.512501 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9bc23602-027d-47fd-8960-a82e22f44268 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.457584 Sep 13 20:02:18.513227 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 516/1020] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:18 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:18.579814 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:18.581056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:18.593405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.594372 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.595360 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:18.596627 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:18.597459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:18.598244 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.174367 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.188506 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bc749c6f-36c9-40fe-bb15-cc7303789472 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1313 microversion: 2.1 time: 0.615958 Sep 13 20:02:19.189623 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 505/1021] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:18 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:19.537353 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:19.537977 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:19.546931 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.547446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.547883 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.548821 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:19.549753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:19.550193 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:19.717791 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:19.726836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-c8efa5ea-1448-4bd4-9c8c-5640e0e407e5 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.193584 Sep 13 20:02:19.727430 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 517/1022] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:19 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:20.227280 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:20.228117 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:20.235935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.236459 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.236981 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.237772 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.238233 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.239115 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.391793 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:20.401059 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e1deb7bc-3c44-4b61-b50f-0a54dafabc9c tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1313 microversion: 2.1 time: 0.178060 Sep 13 20:02:20.401840 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 506/1023] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:20 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:20.753102 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:20.754338 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:20.761871 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.762577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.763151 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.764030 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:20.764590 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:20.765162 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:20.936951 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:20.947479 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-56715b42-5f12-4965-bf7b-4d0911523635 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.199020 Sep 13 20:02:20.948090 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 518/1024] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:20 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:21.428732 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:21.430184 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:21.442742 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.443474 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.444465 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.445784 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.446604 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.447587 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.622851 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:21.631907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-a1f4b6a6-251e-4594-b149-f1ae8503ebed tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1313 microversion: 2.1 time: 0.211196 Sep 13 20:02:21.632524 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 507/1025] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:21 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:21.972836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:21.973639 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:21.980906 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.981424 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.981864 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:21.982587 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:21.983047 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:21.983473 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.144915 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.156170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dc97212a-e5f3-439c-8494-c4fb804fb1a0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.187411 Sep 13 20:02:22.156850 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 519/1026] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:21 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:22.660130 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:22.661282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:22.665639 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=4 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:22.676755 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.677674 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.678487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.679815 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:22.680672 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:22.681485 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:22.881672 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:22.896604 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-8510d4fb-ad73-457c-957a-36aa6b9a45eb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1313 microversion: 2.1 time: 0.243567 Sep 13 20:02:22.897751 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 508/1027] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:22 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:23.026641 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-4e5be803-1482-4142-8984-5993750ad755 req-9de93856-17bb-4880-b8db-d8a5a9ef639c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cea0d8-0e17-47c8-b231-5c352f17d991", "name": "network-vif-plugged", "status": "completed", "tag": "1d4810e4-2f3c-4f43-9639-c4dac1d6bf4b"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:23.033082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=4 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:23.034654 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=12 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:23.048181 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-4e5be803-1482-4142-8984-5993750ad755 req-9de93856-17bb-4880-b8db-d8a5a9ef639c service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.049107 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-4e5be803-1482-4142-8984-5993750ad755 req-9de93856-17bb-4880-b8db-d8a5a9ef639c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.050233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-4e5be803-1482-4142-8984-5993750ad755 req-9de93856-17bb-4880-b8db-d8a5a9ef639c service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.072618 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-4e5be803-1482-4142-8984-5993750ad755 req-9de93856-17bb-4880-b8db-d8a5a9ef639c service nova] Creating event network-vif-plugged:1d4810e4-2f3c-4f43-9639-c4dac1d6bf4b for instance 57cea0d8-0e17-47c8-b231-5c352f17d991 on hv-cinder-82880 Sep 13 20:02:23.081638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-4e5be803-1482-4142-8984-5993750ad755 req-9de93856-17bb-4880-b8db-d8a5a9ef639c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065497 Sep 13 20:02:23.082703 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 520/1028] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:23.181578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:23.182634 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:23.189418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.189969 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.190500 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.191295 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.192055 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.192855 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.367881 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:23.377027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e509c61e-ce69-40d3-8398-665415805035 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.200319 Sep 13 20:02:23.377752 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 509/1029] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:23 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:23.925310 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:23.926077 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:23.933684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.934180 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.934611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:23.935320 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:23.935768 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:23.936185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.102195 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.113738 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-275f693b-5677-49c8-bee6-110930337fa3 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1313 microversion: 2.1 time: 0.193378 Sep 13 20:02:24.114379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 521/1030] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:23 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:24.402887 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:24.404050 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:24.413162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.413829 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.414417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.415501 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:24.416073 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:24.416499 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:24.589579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:24.600024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-10ea4073-f0be-4581-b260-b8522c87f25b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.202540 Sep 13 20:02:24.600620 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 510/1031] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:24 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:25.098987 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-60bcd56f-1c9b-44df-a518-6167e4ac362b req-c8311783-53bf-4e3a-9556-7aaac5806061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1be983b-ba0f-41d1-9ff9-1bae4b7656d0", "name": "network-vif-plugged", "status": "completed", "tag": "682bfae0-aedd-4a6b-b9af-68215492aa65"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:25.109714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-60bcd56f-1c9b-44df-a518-6167e4ac362b req-c8311783-53bf-4e3a-9556-7aaac5806061 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.110467 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-60bcd56f-1c9b-44df-a518-6167e4ac362b req-c8311783-53bf-4e3a-9556-7aaac5806061 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.110596 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-60bcd56f-1c9b-44df-a518-6167e4ac362b req-c8311783-53bf-4e3a-9556-7aaac5806061 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.123113 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-60bcd56f-1c9b-44df-a518-6167e4ac362b req-c8311783-53bf-4e3a-9556-7aaac5806061 service nova] Creating event network-vif-plugged:682bfae0-aedd-4a6b-b9af-68215492aa65 for instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 on hv-cinder-82880 Sep 13 20:02:25.128664 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-60bcd56f-1c9b-44df-a518-6167e4ac362b req-c8311783-53bf-4e3a-9556-7aaac5806061 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033303 Sep 13 20:02:25.129340 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 522/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:25.142553 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.143186 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.149495 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.149983 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.150412 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.151127 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.151583 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.152008 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.311390 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.320461 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-4fa46171-ac9f-4884-8b0d-e331b12be616 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1497 microversion: 2.1 time: 0.181845 Sep 13 20:02:25.321105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 511/1033] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:25 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:25.624006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.625067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.633216 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.633731 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.634295 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.635372 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.636496 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.637127 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.834671 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:25.844455 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-a20709f5-b52c-4309-9138-119ed89bef8d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.224769 Sep 13 20:02:25.847716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 523/1034] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:25 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:25.893555 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:25.894211 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:25.901386 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.901878 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.902314 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.903038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:25.903494 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:25.903918 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:25.932145 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:02:26.022690 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-7d8b98e9-34a5-4988-b39a-0ba813110a3e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "DELETE /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 204 len: 0 microversion: 2.1 time: 0.132913 Sep 13 20:02:26.023299 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 512/1035] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:02:25 2022] DELETE /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:02:26.034120 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:26.034825 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:26.041446 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.041942 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.042368 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.043074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.043531 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.043957 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.194653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:26.202882 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-5dfafb09-6730-4148-a5f2-1b6b274163c4 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1503 microversion: 2.1 time: 0.173815 Sep 13 20:02:26.203463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 524/1036] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:26 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:26.887872 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:26.888568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:26.894927 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.895562 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.895814 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:26.896502 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:26.896946 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:26.897400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.050720 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.059086 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-cee34a0d-0be7-4f14-9cc8-b052cf96ea7e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.175458 Sep 13 20:02:27.059657 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 513/1037] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:26 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:27.227033 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:27.227656 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:27.234721 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.235201 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.235630 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.236415 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:27.236868 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:27.237334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:27.383164 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:27.392574 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-8d951657-a957-4061-a855-372d77a24f8e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1503 microversion: 2.1 time: 0.169656 Sep 13 20:02:27.393233 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 525/1038] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:27 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:28.083249 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:28.084181 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:28.094310 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.094978 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.095579 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.096497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.097017 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.097575 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.117685 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:28.248592 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.256850 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6f72236e-faf5-40a6-bb1f-2836b028b09f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1265 microversion: 2.1 time: 0.178458 Sep 13 20:02:28.257478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 514/1039] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:28 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:28.417316 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:28.417998 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:28.426118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.426674 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.427056 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.427789 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:28.428244 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:28.428682 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:28.622942 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:28.632023 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0624d8ac-5641-467f-a223-78463a63d7db tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1503 microversion: 2.1 time: 0.218822 Sep 13 20:02:28.632588 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 526/1040] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:28 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:29.057990 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-82ce8b8c-809d-4fe5-b186-17661fda6230 req-5ea86443-2383-4343-bd4b-a7d3b82754ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57cea0d8-0e17-47c8-b231-5c352f17d991", "name": "network-vif-deleted", "tag": "1d4810e4-2f3c-4f43-9639-c4dac1d6bf4b"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:29.068734 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-82ce8b8c-809d-4fe5-b186-17661fda6230 req-5ea86443-2383-4343-bd4b-a7d3b82754ec service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.069247 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-82ce8b8c-809d-4fe5-b186-17661fda6230 req-5ea86443-2383-4343-bd4b-a7d3b82754ec service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.069672 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-82ce8b8c-809d-4fe5-b186-17661fda6230 req-5ea86443-2383-4343-bd4b-a7d3b82754ec service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.085021 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-82ce8b8c-809d-4fe5-b186-17661fda6230 req-5ea86443-2383-4343-bd4b-a7d3b82754ec service nova] Creating event network-vif-deleted:1d4810e4-2f3c-4f43-9639-c4dac1d6bf4b for instance 57cea0d8-0e17-47c8-b231-5c352f17d991 on hv-cinder-82880 Sep 13 20:02:29.099631 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-82ce8b8c-809d-4fe5-b186-17661fda6230 req-5ea86443-2383-4343-bd4b-a7d3b82754ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044219 Sep 13 20:02:29.101319 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 515/1041] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:29.287170 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:29.287808 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:29.304630 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.305246 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.305833 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.306577 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.307024 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.307440 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.454853 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:29.458865 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=100 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:29.464528 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-52e2ca85-9230-436d-a987-a354692b1215 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1452 microversion: 2.1 time: 0.181625 Sep 13 20:02:29.465153 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 527/1042] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:29 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:29.491342 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:29.492162 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:29.499349 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.499921 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.500422 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.501179 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.501630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.502051 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.652416 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:29.657422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:29.658034 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:29.661831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-bbd0429b-56c5-4041-a251-c2c1a3acc40b tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1452 microversion: 2.1 time: 0.174829 Sep 13 20:02:29.662581 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 516/1043] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:29 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:29.664662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.665204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.665640 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.666436 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.666893 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.667323 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.704025 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:29.704512 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:29.704989 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:29.705448 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.objects.instance [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lazy-loading 'fault' on Instance uuid 57cea0d8-0e17-47c8-b231-5c352f17d991 {{(pid=132128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:02:29.774800 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:29.783611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-3fa076c4-9386-4e26-836d-f6cc2775d340 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 200 len: 1303 microversion: 2.1 time: 0.130056 Sep 13 20:02:29.784215 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 528/1044] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:29 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 1303 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:30.810993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:30.812085 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: 57cea0d8-0e17-47c8-b231-5c352f17d991] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:30.819258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.819753 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.820325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.821123 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:30.821554 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:30.821980 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:30.836869 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] HTTP exception thrown: Instance 57cea0d8-0e17-47c8-b231-5c352f17d991 could not be found. Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Request method failure captured: Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 HTTP/1.1 Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOHBA0lp4LWiwP0a_DY_Alod4tcxtbOalx43_JJPxgLbkJlkTVJ3AUjD--fGm3bvuf3oC97uSwoN8vqrK1ZZgSDnd3bl2KxiODTBMVlWQH_tqDEWDue-79gLh-VGCI9cL1QEinQTru2ANVEWrYBRsosVknFknuhhum2rDCOMbptt8n4 Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 241fa7029c7d46518c2e36983545cd5c Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-VolumesActionsTest-1992132750 Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:02:30.838565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/241fa7029c7d46518c2e36983545cd5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_241fa7029c7d46518c2e36983545cd5c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/241fa7029c7d46518c2e36983545cd5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/241fa7029c7d46518c2e36983545cd5c"}]}] Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-VolumesActionsTest-1992132750 Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 241fa7029c7d46518c2e36983545cd5c Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-VolumesActionsTest-1992132750 Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-VolumesActionsTest-1992132750-project Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: e240680bbf2c4f02a1429b335261de3d Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-VolumesActionsTest-1992132750-project Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 57cea0d8-0e17-47c8-b231-5c352f17d991 could not be found. Sep 13 20:02:30.840521 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '57cea0d8-0e17-47c8-b231-5c352f17d991'} Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57cea0d8-0e17-47c8-b231-5c352f17d991 could not be found. Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:02:30.850084 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57cea0d8-0e17-47c8-b231-5c352f17d991 could not be found. Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57cea0d8-0e17-47c8-b231-5c352f17d991 could not be found. Sep 13 20:02:30.851660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:02:30.854134 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Returning 404 to user: Instance 57cea0d8-0e17-47c8-b231-5c352f17d991 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:02:30.854134 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-820f826a-3971-4ed0-b27e-c7ed1a8b67fb tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991" status: 404 len: 111 microversion: 2.1 time: 0.033114 Sep 13 20:02:30.854134 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 517/1045] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:30 2022] GET /compute/v2.1/servers/57cea0d8-0e17-47c8-b231-5c352f17d991 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:02:30.992075 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2140817449", "imageRef": "40672fdc-0923-4f7f-aceb-b4e265c5aab0", "flavorRef": "452", "networks": [{"uuid": "9ce68d72-004b-4c7c-839a-ab788b874cb8"}]}} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:31.051894 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.network.neutron [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] validate_networks() for [('9ce68d72-004b-4c7c-839a-ab788b874cb8', None, None, None, None, None)] {{(pid=132128) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 20:02:31.644836 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Flavor limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 20:02:31.645290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Image limits 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 20:02:31.645809 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Flavor pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 20:02:31.646220 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Image pref 0:0:0 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 20:02:31.646801 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.virt.hardware [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 20:02:31.657985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.658856 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.659471 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.660225 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.660687 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.661185 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.686929 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Getting quotas for project 241fa7029c7d46518c2e36983545cd5c. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 20:02:31.688426 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-43b8634e-ef6d-4d7f-9231-92a6c37ea85f req-0c54c1d7-178e-46e8-b0d1-9f7e1261de41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1be983b-ba0f-41d1-9ff9-1bae4b7656d0", "tag": "682bfae0-aedd-4a6b-b9af-68215492aa65"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:31.691110 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.quota [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Getting quotas for user e240680bbf2c4f02a1429b335261de3d and project 241fa7029c7d46518c2e36983545cd5c. Resources: {'ram', 'cores', 'instances'} {{(pid=132128) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 20:02:31.697786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-43b8634e-ef6d-4d7f-9231-92a6c37ea85f req-0c54c1d7-178e-46e8-b0d1-9f7e1261de41 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:31.698255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-43b8634e-ef6d-4d7f-9231-92a6c37ea85f req-0c54c1d7-178e-46e8-b0d1-9f7e1261de41 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:31.698670 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-43b8634e-ef6d-4d7f-9231-92a6c37ea85f req-0c54c1d7-178e-46e8-b0d1-9f7e1261de41 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:31.703337 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Going to run 1 instances... {{(pid=132128) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 20:02:31.705714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='40672fdc-0923-4f7f-aceb-b4e265c5aab0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 20:02:31.710102 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-43b8634e-ef6d-4d7f-9231-92a6c37ea85f req-0c54c1d7-178e-46e8-b0d1-9f7e1261de41 service nova] Creating event network-changed:682bfae0-aedd-4a6b-b9af-68215492aa65 for instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 on hv-cinder-82880 Sep 13 20:02:31.715186 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-43b8634e-ef6d-4d7f-9231-92a6c37ea85f req-0c54c1d7-178e-46e8-b0d1-9f7e1261de41 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030371 Sep 13 20:02:31.715869 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 518/1046] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 20:02:31.763029 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-32745836-13f4-42a9-bde3-94439962c6c6 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774976 Sep 13 20:02:31.764067 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 529/1047] 10.222.0.18 () {60 vars in 1147 bytes} [Tue Sep 13 20:02:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 20:02:31.776105 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-2f698aa4-b3c4-485f-9eec-707e5620ffc7 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:31.777221 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-2f698aa4-b3c4-485f-9eec-707e5620ffc7 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:31.837877 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-2f698aa4-b3c4-485f-9eec-707e5620ffc7 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:31.848260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-2f698aa4-b3c4-485f-9eec-707e5620ffc7 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1214 microversion: 2.1 time: 0.076296 Sep 13 20:02:31.849075 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 519/1048] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:31 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:32.874975 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:32.875625 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:32.883560 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.884045 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.884477 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.885204 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:32.885653 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:32.886071 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:32.949941 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:32.958327 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-7ce9d5cc-806f-4704-b6ef-314e90809337 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1266 microversion: 2.1 time: 0.089907 Sep 13 20:02:32.959159 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 530/1049] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:32 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:33.983699 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:33.984481 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:33.991777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.992277 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.992715 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:33.993480 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:33.993935 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:33.994365 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.186614 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:34.194930 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-695177ef-e6b6-41cf-953a-161ebdb4804b tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1314 microversion: 2.1 time: 0.216460 Sep 13 20:02:34.195607 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 520/1050] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:33 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:34.565172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-cc74dcdf-7ef4-4779-8e4d-ff07fefd963f req-e41bf335-b2b9-4634-bb44-6770f8f14763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed24ff40-7244-4bc7-afc6-b9216b577f3c", "tag": "9c4e3811-a3b3-48c6-9a19-988075f58c8c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:34.583651 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cc74dcdf-7ef4-4779-8e4d-ff07fefd963f req-e41bf335-b2b9-4634-bb44-6770f8f14763 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:34.584135 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cc74dcdf-7ef4-4779-8e4d-ff07fefd963f req-e41bf335-b2b9-4634-bb44-6770f8f14763 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:34.584561 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-cc74dcdf-7ef4-4779-8e4d-ff07fefd963f req-e41bf335-b2b9-4634-bb44-6770f8f14763 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:34.596166 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-cc74dcdf-7ef4-4779-8e4d-ff07fefd963f req-e41bf335-b2b9-4634-bb44-6770f8f14763 service nova] Creating event network-changed:9c4e3811-a3b3-48c6-9a19-988075f58c8c for instance ed24ff40-7244-4bc7-afc6-b9216b577f3c on hv-cinder-82880 Sep 13 20:02:34.601253 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-cc74dcdf-7ef4-4779-8e4d-ff07fefd963f req-e41bf335-b2b9-4634-bb44-6770f8f14763 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039836 Sep 13 20:02:34.601937 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 531/1051] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:35.218704 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:35.219366 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:35.226293 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.226777 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.227212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.227904 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:35.228357 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:35.228776 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:35.364708 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:35.373071 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-93b1d9bd-d9c3-458d-ab36-aff734256364 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1314 microversion: 2.1 time: 0.158134 Sep 13 20:02:35.373822 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 521/1052] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:35 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:36.402766 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:36.403440 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:36.410142 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.410630 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.411059 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.411891 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:36.412369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:36.412786 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:36.557698 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:36.565692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-ea167e81-cf0b-4e99-a271-9c6c5c247f05 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1314 microversion: 2.1 time: 0.167888 Sep 13 20:02:36.566238 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 532/1053] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:36 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:37.589697 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:37.590352 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:37.597805 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.598388 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.606318 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.607128 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:37.607598 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:37.608003 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:37.748671 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:37.758578 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c3656ba8-c7fb-4349-8ae4-2598ffb22d2d tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1314 microversion: 2.1 time: 0.172740 Sep 13 20:02:37.759168 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 522/1054] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:37 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:38.782657 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:38.783269 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:38.785785 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:38.791810 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.792188 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.792611 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.793341 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:38.793790 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:38.794203 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:38.927474 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:38.935793 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-0594adfa-6ab8-4150-8c2e-651e35dc8c75 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1314 microversion: 2.1 time: 0.157740 Sep 13 20:02:38.936356 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 533/1055] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:38 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:39.959438 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:39.960257 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:39.963182 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:39.969568 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.970135 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.970647 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:39.971478 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:39.972021 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:39.972534 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.382908 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:40.391091 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-02674385-eb7f-4742-9b9a-49871a9f42ae tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1314 microversion: 2.1 time: 0.436204 Sep 13 20:02:40.391898 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 523/1056] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:39 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:40.823369 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-1a2dd784-8f29-425b-bf2e-7131d3f757d7 req-eb790873-eb70-4c87-ac75-be92628f3f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed24ff40-7244-4bc7-afc6-b9216b577f3c", "name": "network-vif-plugged", "status": "completed", "tag": "9c4e3811-a3b3-48c6-9a19-988075f58c8c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:40.833813 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1a2dd784-8f29-425b-bf2e-7131d3f757d7 req-eb790873-eb70-4c87-ac75-be92628f3f43 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:40.834296 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1a2dd784-8f29-425b-bf2e-7131d3f757d7 req-eb790873-eb70-4c87-ac75-be92628f3f43 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:40.834707 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-1a2dd784-8f29-425b-bf2e-7131d3f757d7 req-eb790873-eb70-4c87-ac75-be92628f3f43 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:40.846778 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-1a2dd784-8f29-425b-bf2e-7131d3f757d7 req-eb790873-eb70-4c87-ac75-be92628f3f43 service nova] Creating event network-vif-plugged:9c4e3811-a3b3-48c6-9a19-988075f58c8c for instance ed24ff40-7244-4bc7-afc6-b9216b577f3c on hv-cinder-82880 Sep 13 20:02:40.851690 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-1a2dd784-8f29-425b-bf2e-7131d3f757d7 req-eb790873-eb70-4c87-ac75-be92628f3f43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032922 Sep 13 20:02:40.852409 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 534/1057] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:41.415331 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:41.415909 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:41.422853 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.423332 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.423778 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.424488 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:41.425316 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:41.425737 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:41.567958 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:41.575823 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e8f6ad18-a251-4f69-8260-d784bfcb0856 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1314 microversion: 2.1 time: 0.164907 Sep 13 20:02:41.576376 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 524/1058] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:41 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:42.598118 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=2 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:42.599261 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell0:SELECT=6 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:42.606740 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:42.607821 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:42.618668 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.619146 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.619572 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.620254 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:42.620716 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:42.621172 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:42.760317 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:42.768736 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-6b1beaa7-4f4a-41a5-9ed2-8d6c695f253f tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1499 microversion: 2.1 time: 0.172198 Sep 13 20:02:42.769354 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 535/1059] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:42 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:43.358895 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:43.359466 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:43.361250 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell0:SELECT=2 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:43.367594 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.368076 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.368589 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.369312 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.369761 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.370186 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.397193 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:02:43.482063 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1e15c072-4c58-4bd2-b2dc-b7787096075e tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 204 len: 0 microversion: 2.1 time: 0.126651 Sep 13 20:02:43.482998 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 525/1060] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:02:43 2022] DELETE /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:02:43.493801 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:43.494418 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:43.500849 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.501373 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.501812 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.502580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:43.503037 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:43.503460 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:43.639389 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:43.647422 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9c69ce30-d185-4051-98ce-8aa3d886c2e8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1505 microversion: 2.1 time: 0.159659 Sep 13 20:02:43.647994 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 536/1061] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:43 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:02:44.671456 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:44.672191 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:44.679346 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.679907 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.680334 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.681121 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:44.681574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:44.682007 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:44.823495 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:44.833170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-1397f3c2-9ede-4416-8bae-6fe15309c0b8 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1505 microversion: 2.1 time: 0.166042 Sep 13 20:02:44.833786 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 526/1062] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:44 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:45.549863 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-7016933b-8900-4bd2-87d7-1a45cb270631 req-cec02fda-c535-4f9b-a542-6937cc22f562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed24ff40-7244-4bc7-afc6-b9216b577f3c", "name": "network-vif-deleted", "tag": "9c4e3811-a3b3-48c6-9a19-988075f58c8c"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:02:45.560104 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-7016933b-8900-4bd2-87d7-1a45cb270631 req-cec02fda-c535-4f9b-a542-6937cc22f562 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.560580 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-7016933b-8900-4bd2-87d7-1a45cb270631 req-cec02fda-c535-4f9b-a542-6937cc22f562 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.561022 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-7016933b-8900-4bd2-87d7-1a45cb270631 req-cec02fda-c535-4f9b-a542-6937cc22f562 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.572638 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-7016933b-8900-4bd2-87d7-1a45cb270631 req-cec02fda-c535-4f9b-a542-6937cc22f562 service nova] Creating event network-vif-deleted:9c4e3811-a3b3-48c6-9a19-988075f58c8c for instance ed24ff40-7244-4bc7-afc6-b9216b577f3c on hv-cinder-82880 Sep 13 20:02:45.577431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-7016933b-8900-4bd2-87d7-1a45cb270631 req-cec02fda-c535-4f9b-a542-6937cc22f562 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031381 Sep 13 20:02:45.578036 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 537/1063] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:02:45.856026 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:45.856630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:45.864642 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.865282 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.865800 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.866604 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.867278 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.867802 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.901024 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:45.901600 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:45.901962 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:45.902405 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.objects.instance [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lazy-loading 'fault' on Instance uuid ed24ff40-7244-4bc7-afc6-b9216b577f3c {{(pid=132127) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 20:02:45.947243 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e240680bbf2c4f02a1429b335261de3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '241fa7029c7d46518c2e36983545cd5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:02:45.955665 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-37bab67e-1f61-4176-9b56-ce5e62945e77 tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 200 len: 1304 microversion: 2.1 time: 0.103589 Sep 13 20:02:45.956255 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 527/1064] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:45 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:02:46.984784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:02:46.985522 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] [instance: ed24ff40-7244-4bc7-afc6-b9216b577f3c] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:02:46.993566 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.994062 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.994550 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:46.995260 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:02:46.995714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:02:46.996541 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:02:47.013054 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] HTTP exception thrown: Instance ed24ff40-7244-4bc7-afc6-b9216b577f3c could not be found. Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Request method failure captured: Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c HTTP/1.1 Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOHBA0lp4LWiwP0a_DY_Alod4tcxtbOalx43_JJPxgLbkJlkTVJ3AUjD--fGm3bvuf3oC97uSwoN8vqrK1ZZgSDnd3bl2KxiODTBMVlWQH_tqDEWDue-79gLh-VGCI9cL1QEinQTru2ANVEWrYBRsosVknFknuhhum2rDCOMbptt8n4 Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 241fa7029c7d46518c2e36983545cd5c Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-VolumesActionsTest-1992132750 Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:02:47.014732 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/241fa7029c7d46518c2e36983545cd5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_241fa7029c7d46518c2e36983545cd5c", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/241fa7029c7d46518c2e36983545cd5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/241fa7029c7d46518c2e36983545cd5c"}]}] Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-VolumesActionsTest-1992132750 Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 241fa7029c7d46518c2e36983545cd5c Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-VolumesActionsTest-1992132750 Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-VolumesActionsTest-1992132750-project Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: e240680bbf2c4f02a1429b335261de3d Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-VolumesActionsTest-1992132750-project Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance ed24ff40-7244-4bc7-afc6-b9216b577f3c could not be found. Sep 13 20:02:47.016374 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'ed24ff40-7244-4bc7-afc6-b9216b577f3c'} Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed24ff40-7244-4bc7-afc6-b9216b577f3c could not be found. Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:02:47.017286 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed24ff40-7244-4bc7-afc6-b9216b577f3c could not be found. Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed24ff40-7244-4bc7-afc6-b9216b577f3c could not be found. Sep 13 20:02:47.018606 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:02:47.019765 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] Returning 404 to user: Instance ed24ff40-7244-4bc7-afc6-b9216b577f3c could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:02:47.019765 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-09f8a8df-4dfc-4027-9508-2d430bca2e7a tempest-VolumesActionsTest-1992132750 tempest-VolumesActionsTest-1992132750-project] 10.222.0.18 "GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c" status: 404 len: 111 microversion: 2.1 time: 0.036797 Sep 13 20:02:47.019765 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 538/1065] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:02:46 2022] GET /compute/v2.1/servers/ed24ff40-7244-4bc7-afc6-b9216b577f3c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:17.392630 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:17.393311 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:17.395229 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [req-3511ad0a-8613-4544-82e3-ddc484feddd8 req-9d24dbd0-488d-44a3-b199-75cfcf0b3434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "247f7a0a-2a2e-4b40-a96a-f31589cc5810", "tag": "e3d7babf-a6ba-404e-b3eb-a17c07fabe90"}]} {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:03:17.395694 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:17.396218 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:17.403403 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.403876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.404516 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.405239 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.405688 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.405987 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=11 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:17.406095 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.406839 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=48 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:17.409574 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3511ad0a-8613-4544-82e3-ddc484feddd8 req-9d24dbd0-488d-44a3-b199-75cfcf0b3434 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.410764 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3511ad0a-8613-4544-82e3-ddc484feddd8 req-9d24dbd0-488d-44a3-b199-75cfcf0b3434 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.411420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [req-3511ad0a-8613-4544-82e3-ddc484feddd8 req-9d24dbd0-488d-44a3-b199-75cfcf0b3434 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.425902 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.compute.server_external_events [req-3511ad0a-8613-4544-82e3-ddc484feddd8 req-9d24dbd0-488d-44a3-b199-75cfcf0b3434 service nova] Creating event network-changed:e3d7babf-a6ba-404e-b3eb-a17c07fabe90 for instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 on hv-cinder-82880 Sep 13 20:03:17.432835 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [req-3511ad0a-8613-4544-82e3-ddc484feddd8 req-9d24dbd0-488d-44a3-b199-75cfcf0b3434 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041837 Sep 13 20:03:17.434128 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 539/1066] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:03:17.441206 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Going to try to terminate instance {{(pid=132127) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:03:17.545458 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-aae4c503-7603-43f1-8cd6-43974984367c tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "DELETE /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 204 len: 0 microversion: 2.1 time: 0.156425 Sep 13 20:03:17.550476 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 528/1067] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:03:17 2022] DELETE /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 20:03:17.556565 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:17.557329 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:17.564380 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.565063 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.565516 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.566238 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:17.566696 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:17.567290 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:17.738722 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:17.746971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-915d122a-8f8d-4fd1-a9c5-cf04cfabb2ff tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.195159 Sep 13 20:03:17.747549 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 540/1068] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:17 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:03:18.771362 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:18.771979 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:18.778637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.779112 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.779537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.780231 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:18.780673 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:18.781126 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:18.928852 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:18.936934 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-c9f64ed0-8629-4ed7-b7b5-a4f1d2a6444e tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.170011 Sep 13 20:03:18.937530 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 529/1069] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:18 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:19.961257 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:19.961858 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:19.969097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.969536 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.969949 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:19.970686 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:19.971160 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:19.971600 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:20.113141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:20.121474 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-98bfa81c-f83a-43fb-a4ff-448cf65d7a63 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.164367 Sep 13 20:03:20.122023 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 541/1070] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:19 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:21.152692 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:21.153335 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:21.164361 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:21.164852 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:21.165325 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:21.166027 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:21.166482 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:21.166903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:21.316577 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:21.325295 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6b478989-cd0e-49e0-b981-1c2cfd23a489 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1568 microversion: 2.1 time: 0.176605 Sep 13 20:03:21.331728 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 530/1071] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:21 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:22.349458 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:22.350057 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:22.357304 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.357416 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.357771 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.358517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.358965 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.359411 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.454460 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-0655f5f1-fe2c-41a3-92ee-8ed4f61d0bab req-cb73bb99-42d9-40b7-90d8-bd94f448a239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "247f7a0a-2a2e-4b40-a96a-f31589cc5810", "name": "network-vif-deleted", "tag": "e3d7babf-a6ba-404e-b3eb-a17c07fabe90"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:03:22.460784 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ca934350c71421cb644b3a380e96df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '838511c93b924f118bcfc03ecfd870b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:03:22.465868 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-0655f5f1-fe2c-41a3-92ee-8ed4f61d0bab req-cb73bb99-42d9-40b7-90d8-bd94f448a239 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:22.466417 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-0655f5f1-fe2c-41a3-92ee-8ed4f61d0bab req-cb73bb99-42d9-40b7-90d8-bd94f448a239 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:22.466868 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-0655f5f1-fe2c-41a3-92ee-8ed4f61d0bab req-cb73bb99-42d9-40b7-90d8-bd94f448a239 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:22.473082 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-1bd53a4c-b51b-4242-9006-98820f68f67a tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 200 len: 1382 microversion: 2.1 time: 0.126929 Sep 13 20:03:22.473674 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 542/1072] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:22 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 1382 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:03:22.479258 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-0655f5f1-fe2c-41a3-92ee-8ed4f61d0bab req-cb73bb99-42d9-40b7-90d8-bd94f448a239 service nova] Creating event network-vif-deleted:e3d7babf-a6ba-404e-b3eb-a17c07fabe90 for instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 on hv-cinder-82880 Sep 13 20:03:22.491771 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-0655f5f1-fe2c-41a3-92ee-8ed4f61d0bab req-cb73bb99-42d9-40b7-90d8-bd94f448a239 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043012 Sep 13 20:03:22.492613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 531/1073] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:03:23.497289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:23.497913 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [instance: 247f7a0a-2a2e-4b40-a96a-f31589cc5810] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:03:23.504672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.505190 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.505623 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.506324 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:03:23.506803 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:03:23.507221 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:03:23.521780 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] HTTP exception thrown: Instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 could not be found. Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Request method failure captured: Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 HTTP/1.1 Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIODygwq3XE98TWGfeAnKD7jRD8dQdo5C42oakL1xGRIiVZ-dpvNcjF-AX05k8_1nLKRjK6rVVg3ypiUF759hfGOFUfsI5YWOdGFI-wk4_CLDP96WA-oxyaoGA2IEZKhKhz0xMM6NAV9dpq2jWuJpBGfFlbu1pJVc5rDdI2pDNWpjCVc Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 838511c93b924f118bcfc03ecfd870b2 Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-TestShelveInstance-1464038132 Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:03:23.523627 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/838511c93b924f118bcfc03ecfd870b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_838511c93b924f118bcfc03ecfd870b2", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/838511c93b924f118bcfc03ecfd870b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/838511c93b924f118bcfc03ecfd870b2"}]}] Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-TestShelveInstance-1464038132 Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 838511c93b924f118bcfc03ecfd870b2 Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-TestShelveInstance-1464038132 Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-TestShelveInstance-1464038132-project Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 9ca934350c71421cb644b3a380e96df2 Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-TestShelveInstance-1464038132-project Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 could not be found. Sep 13 20:03:23.525289 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': '247f7a0a-2a2e-4b40-a96a-f31589cc5810'} Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 could not be found. Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:03:23.526435 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 could not be found. Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 could not be found. Sep 13 20:03:23.528497 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:03:23.530097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Returning 404 to user: Instance 247f7a0a-2a2e-4b40-a96a-f31589cc5810 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:03:23.530097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-d7242536-28d6-4068-aa5a-17101befb402 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810" status: 404 len: 111 microversion: 2.1 time: 0.031764 Sep 13 20:03:23.530097 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 543/1074] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:03:23 2022] GET /compute/v2.1/servers/247f7a0a-2a2e-4b40-a96a-f31589cc5810 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:23.709917 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-e71b3eb2-b57d-46b0-88ea-c6c33c415587 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] Calling method '.version_select at 0x7f98b68071f0>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:03:23.715746 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e71b3eb2-b57d-46b0-88ea-c6c33c415587 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [29638779-ba54-4b09-a7eb-8c4d28f4f820] AMQP server on 10.222.0.18:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 13 20:03:24.723744 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO oslo.messaging._drivers.impl_rabbit [None req-e71b3eb2-b57d-46b0-88ea-c6c33c415587 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] [29638779-ba54-4b09-a7eb-8c4d28f4f820] Reconnected to AMQP server on 10.222.0.18:5672 via [amqp] client with port 33172. Sep 13 20:03:24.745828 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-e71b3eb2-b57d-46b0-88ea-c6c33c415587 tempest-TestShelveInstance-1464038132 tempest-TestShelveInstance-1464038132-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011659936" status: 202 len: 0 microversion: 2.1 time: 1.040499 Sep 13 20:03:24.746574 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 532/1075] 10.222.0.18 () {58 vars in 1254 bytes} [Tue Sep 13 20:03:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011659936 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 20:04:11.875704 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:11.876276 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:11.879103 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:11.879926 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG dbcounter [-] [132127] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:11.884932 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-cf9d2508-5115-4147-ab6c-3d5876f59073 req-4fa2bdcb-fc63-4e95-b1c6-0599df031f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1be983b-ba0f-41d1-9ff9-1bae4b7656d0", "tag": "682bfae0-aedd-4a6b-b9af-68215492aa65"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:04:11.887684 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_api:SELECT=10 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:11.888321 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG dbcounter [-] [132128] Writing DB stats nova_cell1:SELECT=22 {{(pid=132128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:11.894749 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:11.895240 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:11.895672 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.896378 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:11.896830 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:11.909578 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.913121 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-cf9d2508-5115-4147-ab6c-3d5876f59073 req-4fa2bdcb-fc63-4e95-b1c6-0599df031f78 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:11.913759 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-cf9d2508-5115-4147-ab6c-3d5876f59073 req-4fa2bdcb-fc63-4e95-b1c6-0599df031f78 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:11.915583 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-cf9d2508-5115-4147-ab6c-3d5876f59073 req-4fa2bdcb-fc63-4e95-b1c6-0599df031f78 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:11.930345 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-cf9d2508-5115-4147-ab6c-3d5876f59073 req-4fa2bdcb-fc63-4e95-b1c6-0599df031f78 service nova] Creating event network-changed:682bfae0-aedd-4a6b-b9af-68215492aa65 for instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 on hv-cinder-82880 Sep 13 20:04:11.936358 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-cf9d2508-5115-4147-ab6c-3d5876f59073 req-4fa2bdcb-fc63-4e95-b1c6-0599df031f78 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058612 Sep 13 20:04:11.940429 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 533/1076] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:04:11.943463 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:04:12.037955 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-2e4850f1-7a0c-40c0-af0d-071ec8a9fa2e tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "DELETE /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 204 len: 0 microversion: 2.1 time: 0.166036 Sep 13 20:04:12.038832 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 544/1077] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:04:11 2022] DELETE /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:04:12.054439 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:12.055739 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:12.066406 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.067260 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.068041 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.069585 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:12.070418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:12.071170 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:12.208985 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:12.217092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-5090fa86-50eb-48aa-85e3-9a0ebbd485ad tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1577 microversion: 2.1 time: 0.172635 Sep 13 20:04:12.217671 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 534/1078] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:12 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:13.241413 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:13.242132 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:13.249474 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.250038 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.250432 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.251171 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:13.251568 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:13.251984 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:13.427923 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:13.436595 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-584d2043-b3c2-4d83-bfdf-af8c5d0f2bbe tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1577 microversion: 2.1 time: 0.199419 Sep 13 20:04:13.437311 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 545/1079] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:13 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:14.223991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-2b26771e-d079-4945-adc5-c7c53f8dae2c req-c0b7295a-be89-4da9-8f0e-e4064626c4ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1be983b-ba0f-41d1-9ff9-1bae4b7656d0", "name": "network-vif-deleted", "tag": "682bfae0-aedd-4a6b-b9af-68215492aa65"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:04:14.236644 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-2b26771e-d079-4945-adc5-c7c53f8dae2c req-c0b7295a-be89-4da9-8f0e-e4064626c4ce service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.237232 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-2b26771e-d079-4945-adc5-c7c53f8dae2c req-c0b7295a-be89-4da9-8f0e-e4064626c4ce service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.237656 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-2b26771e-d079-4945-adc5-c7c53f8dae2c req-c0b7295a-be89-4da9-8f0e-e4064626c4ce service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.249110 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-2b26771e-d079-4945-adc5-c7c53f8dae2c req-c0b7295a-be89-4da9-8f0e-e4064626c4ce service nova] Creating event network-vif-deleted:682bfae0-aedd-4a6b-b9af-68215492aa65 for instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 on hv-cinder-82880 Sep 13 20:04:14.254697 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-2b26771e-d079-4945-adc5-c7c53f8dae2c req-c0b7295a-be89-4da9-8f0e-e4064626c4ce service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Sep 13 20:04:14.255308 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 535/1080] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:04:14.465652 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:14.466300 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:14.475985 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.476451 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.477141 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.477852 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:14.478322 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:14.478889 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:14.547481 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:14.564442 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-dbd65798-3b32-4784-9fa4-d0fdcf6ad050 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 200 len: 1225 microversion: 2.1 time: 0.106042 Sep 13 20:04:14.565379 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 546/1081] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:14 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:15.588497 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:15.589212 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: e1be983b-ba0f-41d1-9ff9-1bae4b7656d0] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:15.596343 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.596834 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.597347 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:15.598056 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:15.598492 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:15.598910 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:15.615484 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] HTTP exception thrown: Instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 could not be found. Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Request method failure captured: Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 HTTP/1.1 Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOCkk_OHYnd_4HehShJhcd6IaTcqjOBdULzudF7I9SKmGZ_XbwYTHBDnoGJROd25OxnIOo9qH_8VtjZsA4NkNlEiO9WminbXD5bTDF_ueJHlJYu_Jec7FBwsIaQu_TvGwXd5vEhBEx6B1Aj3QMaNIYotpnfRBk2XU8mYsSKq91kcC6s Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:04:15.617199 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_245af7b7ed61405ba444cddd26fc69fd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}] Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 4f63b1c74b4b4d34b33bef2b6267ecb2 Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 could not be found. Sep 13 20:04:15.619045 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'e1be983b-ba0f-41d1-9ff9-1bae4b7656d0'} Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 could not be found. Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:04:15.620046 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 could not be found. Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 could not be found. Sep 13 20:04:15.621794 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:15.623335 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Returning 404 to user: Instance e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:04:15.623335 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-16d7efd2-5caf-4074-8d3e-9c54a3c28047 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0" status: 404 len: 111 microversion: 2.1 time: 0.034904 Sep 13 20:04:15.623335 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 536/1082] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:15 2022] GET /compute/v2.1/servers/e1be983b-ba0f-41d1-9ff9-1bae4b7656d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:18.803212 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:18.803900 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-947c6638-82c1-42b1-bbcb-b5a04cc42aec req-64cd0b1c-7b44-4f8c-bc8b-b17f02f0368f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a201a74-9532-4339-8870-162f853a6997", "tag": "f8364066-d849-42c6-8131-ce38b1455a42"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:04:18.804773 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:18.812334 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.812834 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.813309 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.814006 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.814469 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.814900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.815968 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-947c6638-82c1-42b1-bbcb-b5a04cc42aec req-64cd0b1c-7b44-4f8c-bc8b-b17f02f0368f service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.816509 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-947c6638-82c1-42b1-bbcb-b5a04cc42aec req-64cd0b1c-7b44-4f8c-bc8b-b17f02f0368f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.817620 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-947c6638-82c1-42b1-bbcb-b5a04cc42aec req-64cd0b1c-7b44-4f8c-bc8b-b17f02f0368f service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.833378 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-947c6638-82c1-42b1-bbcb-b5a04cc42aec req-64cd0b1c-7b44-4f8c-bc8b-b17f02f0368f service nova] Creating event network-changed:f8364066-d849-42c6-8131-ce38b1455a42 for instance 4a201a74-9532-4339-8870-162f853a6997 on hv-cinder-82880 Sep 13 20:04:18.838660 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-947c6638-82c1-42b1-bbcb-b5a04cc42aec req-64cd0b1c-7b44-4f8c-bc8b-b17f02f0368f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040048 Sep 13 20:04:18.839807 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 537/1083] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:04:18.841714 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Going to try to terminate instance {{(pid=132128) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 20:04:18.925842 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-56f7cafb-ca7f-45e1-baf2-b284b88d0150 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 204 len: 0 microversion: 2.1 time: 0.127016 Sep 13 20:04:18.929951 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 547/1084] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:04:18 2022] DELETE /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 20:04:18.936305 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:18.937062 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:18.944222 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.944713 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.945176 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:18.945888 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:18.946402 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:18.946850 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:19.088637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.policy [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132127) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:19.097446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-87b504fd-f974-41f4-8038-be0b4ff74e01 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1577 microversion: 2.1 time: 0.165715 Sep 13 20:04:19.098053 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 538/1085] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:18 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 20:04:20.124243 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:20.125074 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:20.135048 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.135523 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.135960 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.136692 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:20.137179 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:20.137604 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:20.286971 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:20.295086 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-56b64df9-eaf5-43ee-8aff-59468664039d tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1577 microversion: 2.1 time: 0.176826 Sep 13 20:04:20.295679 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 548/1086] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:20 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:21.109483 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [req-98fb0f6f-194e-4e96-beff-732029318b4c req-b83a0cfa-df26-4ff0-bc27-333c48afb8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a201a74-9532-4339-8870-162f853a6997", "name": "network-vif-deleted", "tag": "f8364066-d849-42c6-8131-ce38b1455a42"}]} {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 20:04:21.120161 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-98fb0f6f-194e-4e96-beff-732029318b4c req-b83a0cfa-df26-4ff0-bc27-333c48afb8a5 service nova] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.120637 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-98fb0f6f-194e-4e96-beff-732029318b4c req-b83a0cfa-df26-4ff0-bc27-333c48afb8a5 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.121112 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [req-98fb0f6f-194e-4e96-beff-732029318b4c req-b83a0cfa-df26-4ff0-bc27-333c48afb8a5 service nova] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.132418 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.compute.server_external_events [req-98fb0f6f-194e-4e96-beff-732029318b4c req-b83a0cfa-df26-4ff0-bc27-333c48afb8a5 service nova] Creating event network-vif-deleted:f8364066-d849-42c6-8131-ce38b1455a42 for instance 4a201a74-9532-4339-8870-162f853a6997 on hv-cinder-82880 Sep 13 20:04:21.137613 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [req-98fb0f6f-194e-4e96-beff-732029318b4c req-b83a0cfa-df26-4ff0-bc27-333c48afb8a5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031924 Sep 13 20:04:21.138201 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 539/1087] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Sep 13 20:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 20:04:21.319431 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:21.319981 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:21.326823 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.327321 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.327753 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.328459 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:21.328945 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:21.329376 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:21.397420 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.policy [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f63b1c74b4b4d34b33bef2b6267ecb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '245af7b7ed61405ba444cddd26fc69fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132128) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 20:04:21.410805 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-9d291feb-80ca-4879-b4c2-9a533bc6d90f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 200 len: 1225 microversion: 2.1 time: 0.095425 Sep 13 20:04:21.411662 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 549/1088] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:21 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 20:04:22.438144 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:22.438831 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: 4a201a74-9532-4339-8870-162f853a6997] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:22.445400 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.445893 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.446336 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.447038 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.447487 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.447910 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.462401 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] HTTP exception thrown: Instance 4a201a74-9532-4339-8870-162f853a6997 could not be found. Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Request method failure captured: Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 HTTP/1.1 Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOCkk_OHYnd_4HehShJhcd6IaTcqjOBdULzudF7I9SKmGZ_XbwYTHBDnoGJROd25OxnIOo9qH_8VtjZsA4NkNlEiO9WminbXD5bTDF_ueJHlJYu_Jec7FBwsIaQu_TvGwXd5vEhBEx6B1Aj3QMaNIYotpnfRBk2XU8mYsSKq91kcC6s Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:04:22.464092 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_245af7b7ed61405ba444cddd26fc69fd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}] Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 4f63b1c74b4b4d34b33bef2b6267ecb2 Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance 4a201a74-9532-4339-8870-162f853a6997 could not be found. Sep 13 20:04:22.465876 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': '4a201a74-9532-4339-8870-162f853a6997'} Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a201a74-9532-4339-8870-162f853a6997 could not be found. Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:04:22.466903 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a201a74-9532-4339-8870-162f853a6997 could not be found. Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a201a74-9532-4339-8870-162f853a6997 could not be found. Sep 13 20:04:22.468513 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.469991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Returning 404 to user: Instance 4a201a74-9532-4339-8870-162f853a6997 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:04:22.469991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-6e081f07-0be3-4fdb-b576-85b70971b4dc tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997" status: 404 len: 111 microversion: 2.1 time: 0.032337 Sep 13 20:04:22.469991 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 540/1089] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:22 2022] GET /compute/v2.1/servers/4a201a74-9532-4339-8870-162f853a6997 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:22.934972 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:22.935542 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.compute.api [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132128) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:22.942452 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.942873 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.943517 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.944582 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.945330 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.945912 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG oslo_concurrency.lockutils [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.964150 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.wsgi [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] HTTP exception thrown: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Request method failure captured: Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: request: DELETE /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 HTTP/1.1 Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept: application/json Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Accept-Encoding: identity Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Connection: close Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Length: 0 Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Content-Type: application/json Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Host: 10.222.0.18 Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: Openstack-System-Scope: None Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: User-Agent: python-urllib3/1.26.12 Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Auth-Token: gAAAAABjIOCkk_OHYnd_4HehShJhcd6IaTcqjOBdULzudF7I9SKmGZ_XbwYTHBDnoGJROd25OxnIOo9qH_8VtjZsA4NkNlEiO9WminbXD5bTDF_ueJHlJYu_Jec7FBwsIaQu_TvGwXd5vEhBEx6B1Aj3QMaNIYotpnfRBk2XU8mYsSKq91kcC6s Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Id: None Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Domain-Name: None Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Identity-Status: Confirmed Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Is-Admin-Project: True Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Id: default Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Domain-Name: Default Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Project-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Role: member,reader Sep 13 20:04:22.965900 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Roles: member,reader Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_245af7b7ed61405ba444cddd26fc69fd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}] Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-Tenant-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Id: default Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Domain-Name: Default Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Id: 4f63b1c74b4b4d34b33bef2b6267ecb2 Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: X-User-Name: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: method: > Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: exception: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:22.968143 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: action_args: {'id': 'd29fad67-f6ab-422e-9cb7-549c00245204'} Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:04:22.969344 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:22.971271 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: ERROR nova.api.openstack.wsgi Sep 13 20:04:22.973328 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Returning 404 to user: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. {{(pid=132128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:04:22.973328 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-75382db4-60eb-48fd-a18f-e6c2a133a0cf tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "DELETE /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 404 len: 111 microversion: 2.1 time: 0.036670 Sep 13 20:04:22.973328 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 550/1090] 10.222.0.18 () {58 vars in 1239 bytes} [Tue Sep 13 20:04:22 2022] DELETE /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:22.980544 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '>' {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:22.981446 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.compute.api [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] [instance: d29fad67-f6ab-422e-9cb7-549c00245204] Fetching instance by UUID {{(pid=132127) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 20:04:22.988625 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.989136 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.989565 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:22.990287 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Acquiring lock "50830944-793d-4e46-b527-41f92d9eef04" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 20:04:22.990733 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 20:04:22.991846 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG oslo_concurrency.lockutils [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Lock "50830944-793d-4e46-b527-41f92d9eef04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132127) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 20:04:23.005503 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.wsgi [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] HTTP exception thrown: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Request method failure captured: Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: request: GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 HTTP/1.1 Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept: application/json Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Accept-Encoding: identity Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Connection: close Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Length: 0 Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Content-Type: application/json Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Host: 10.222.0.18 Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: Openstack-System-Scope: None Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: User-Agent: python-urllib3/1.26.12 Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Auth-Token: gAAAAABjIOCkk_OHYnd_4HehShJhcd6IaTcqjOBdULzudF7I9SKmGZ_XbwYTHBDnoGJROd25OxnIOo9qH_8VtjZsA4NkNlEiO9WminbXD5bTDF_ueJHlJYu_Jec7FBwsIaQu_TvGwXd5vEhBEx6B1Aj3QMaNIYotpnfRBk2XU8mYsSKq91kcC6s Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Id: None Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Domain-Name: None Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Identity-Status: Confirmed Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Is-Admin-Project: True Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Id: default Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Domain-Name: Default Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Project-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Role: member,reader Sep 13 20:04:23.007054 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Roles: member,reader Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:8080/v1/AUTH_245af7b7ed61405ba444cddd26fc69fd", "adminURL": "http://10.222.0.18:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/245af7b7ed61405ba444cddd26fc69fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/245af7b7ed61405ba444cddd26fc69fd"}]}] Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Id: 245af7b7ed61405ba444cddd26fc69fd Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-Tenant-Name: tempest-TestVolumeBootPattern-1456580622 Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Id: default Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Domain-Name: Default Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Id: 4f63b1c74b4b4d34b33bef2b6267ecb2 Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: X-User-Name: tempest-TestVolumeBootPattern-1456580622-project Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: method: > Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: exception: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:23.008993 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: action_args: {'id': 'd29fad67-f6ab-422e-9cb7-549c00245204'} Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: {{(pid=132127) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 20:04:23.009951 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. Sep 13 20:04:23.011537 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: ERROR nova.api.openstack.wsgi Sep 13 20:04:23.013384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: DEBUG nova.api.openstack.wsgi [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Returning 404 to user: Instance d29fad67-f6ab-422e-9cb7-549c00245204 could not be found. {{(pid=132127) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 20:04:23.013384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: INFO nova.api.openstack.requestlog [None req-46717f02-23c4-45e4-b74d-9816cc5ed20f tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204" status: 404 len: 111 microversion: 2.1 time: 0.033950 Sep 13 20:04:23.013384 dv-cinder-828806-6-iscsi devstack@n-api.service[132127]: [pid: 132127|app: 0|req: 541/1091] 10.222.0.18 () {58 vars in 1236 bytes} [Tue Sep 13 20:04:22 2022] GET /compute/v2.1/servers/d29fad67-f6ab-422e-9cb7-549c00245204 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 20:04:24.337952 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: DEBUG nova.api.openstack.wsgi [None req-284f6814-423b-4de7-ae58-343d9e4b2ae0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] Calling method '.version_select at 0x7f98b6965ca0>' {{(pid=132128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 20:04:24.361527 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: INFO nova.api.openstack.requestlog [None req-284f6814-423b-4de7-ae58-343d9e4b2ae0 tempest-TestVolumeBootPattern-1456580622 tempest-TestVolumeBootPattern-1456580622-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241128332" status: 202 len: 0 microversion: 2.1 time: 0.027450 Sep 13 20:04:24.362138 dv-cinder-828806-6-iscsi devstack@n-api.service[132128]: [pid: 132128|app: 0|req: 551/1092] 10.222.0.18 () {58 vars in 1260 bytes} [Tue Sep 13 20:04:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-241128332 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)